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ABSTRACT 

Presented are 28 papers given at a 1972 conference on 
electronic prosthetics for the handicapped. Among the papers are the 
following titles: "Therapy for Cerebral Palsy Employing Artifician 
Sense Organs for Alternatives to Proprioceptive Feedback"; "Excessive 
Neuromuscular Time Delay as a Possible Cause of Poor Hand-Eye 
Coordination and Hyperactivity"; "The Electric Pencil--A Device for 
Training in Fine Motor Skills"; "The Tufts Interactive Communicator"; 
"A Communications Prosthesis for the Quadriplegic"; "Apparatus 
Actuating and Call System for Incapacitated Patients"; "Magnetically 
Coupled Stimulation of the Ossicular Chain in Kangaroo Rat and Man"; 
"Mechanical Speech Recognition for the Paralyzed or Profoundly Deaf"; 
"Toward Optimum Synthetic Speech for the Deaf"; "Transportation for 
the Severely Disabled — Design Problems in a Personal Car"; "A Digital 
Pitches ensitive Controller for an Electric Wheelchair" ; "A Reclini ng 
Wheelchair that Provides Height Shifting Mobility for the 
Quadriplegic" ; "A Survey of Electric Wheelchair Power Supplies" ; " A 
Voice Controlled Telephone for the Motion Handicapped" ; "A 
Self-Timing Index Tone Generator"; "An Automated Reading Service for 
the Blind"; "An on-Line System forlmmediate Braille Presentation of 
Computer Stored Information to the Blind"; "Toward Improving the 
Optacon"; "Mobile Platform for the Paraplegic"; "Evaluation of the 
Ultrasonic Binaural Sensor in Rehabilitation and Mobility of the 
Blind"; "The Heugel Quill — A New Tactile Development for the Blind"; 
and "Optical Analog Biofeedback Control and Learning Devices" • 
(DB) 
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THERAPY FOR CEREBRAL PALSY E>i?LOYING ARTIFICIAL SENSE ORGANS 



FOR ALTERNATIVES TO PROPRIOCEPTIVE FEEDBACK 
by 

F. A. Harris, Ph.D. 
F. A. Spelman and J.' W, Hymer 
Department of Physiology and Biophysics 
University of Washington 
Medical School and Regional Primate Research Center 
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Introduction 

• Federal assistanc-j for the education of handi- 
capped children, provided through Title VI-B fund- 
ing,* has made it possible to bring concepts from 
neurophysiology and hardware from bioengineering to 
bear on the stability and mobility problems of 
athecoid cerebral palsied (CP) children. A team 
comprised of a neurophysiologist , an elect:rical 
engineer and an electronics specialist have devised 
artificial sense organs and feedback devices which 
are utilized by physical and occupational thera- 
pists in treatment of CP children in the Orthopedic 
Wing of the Lowell School in Seattle, Washington. 
The project represents a major facet of the Program 
for the Physi 'tally Handicapped in the Special 
Education Department of the Seattle Public Schools. 

Rationale 

While clinical neurologists traditionally view 
athetoid movements (described as wormlike, random, 
purposeless, writhing movements of the head and ex- 
tremities) (1) made by CP individuals as a direct 
expression of pathological neuronal discharge pat- 
terns intrinsic to damaged subcortical motor 
centers^ modern engineering concepts provide an al- 
ternate explanation for 'involuntary movements" in 



* Title VI-B, ESEA, under P.L, 89-313, HEW Office 
of Education. 



terras of defective control system function. What 
have been viewed as primary motor disturbances may 
actually be sensory disturbances, in that altera- 
tions in muscle stretch receptor sensitivity might 
distort proprioceptive feedback to the point that 
postural stability and the execution of smooth vol- 
untary movements are impossible (2). An obvious 
possibility for the production of changes in 
stretch receptor sensitivity (either in the direc- 
tion of derangement or towards compensatory re- 
adiuatment) exists by virtue of the control of 
stretch receptors through the gamma efferent 
system (3). An indication of the actual occurrence 
of such derangement is that some children reporting 
on the subjective experience of passive manipula- 
tion or active movement of their extremities give 
the impression that they receive no information 
about limb position via proprioceptive channels 
(except for joint pain felt at the extremes of the 
range of motion). 

The postulate that athetoid movements of the 
head and limbs result from impaired proprioceptive 
feedback is being tested by devising artificial 
sense organs which provide feedback over auditory 
and visual pathways to inform CP children of the 
positions of their heads and extremities. The sub- 
stitute feedback systems for head and limb position 
control use sensors patterned after receptors in 
the vestibular system and. joint-angle receptors. 
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FIGURE 1. Block diagram of a balance control device. 
1 



respectively. Provision is made in each system for 
automatically reinforcing the children for their 
efforts at position control using inforraacion ob- 
tained via the alternate feedback channels. Com- 
parisons of postural stability and quality of vol- 
untary movement, sampled with and without the use 
of the assistive devices, are made for each child 
through the use of filmed examples of particular 
postures and movement activities. 

Balance Control Device (BCD) 

The BCD employs mechano-elec tr icai transducers 
(rotational potentiometers with pendulums attached 
to their shafts) Co measure fore-and-aft and side- 
to-side tilt of the head. The two transducers are 
mounttd on, and the stimulators for auditory feed- 
back mounted within, a helmet worn by the subject 
(Fig. 1). Tilt is converted to rotation of the 
potentiometer shafts via the pendulums; the poten- 
tiometer outputs are then converted to a pulse fre- 
quency code by voltage-controlled oscillator cir- 
cuits. The oscillators drive piezoelectric 
"unimorphs" which produce a click sound for each 
pulse. As the head deviates from the neutral posi- 
tion, the subject hears clicks emanating from the 
unimorph positioned on the side of the helmet 
toward which the head is tilting. Click frequency 
increases linearly with tilt (accurate to 2 per cent 
within the range of plus or minus 20 degrees). Thus 
the subject "hears" his head position in terms of 
the pattern of sound within the helmet, and "steers" 
towards a neutral head position indicated by near or 
total absence of sound in both fore-and-aft and 
side- to-*side channels. In daily prescribed activi- 
ties, the child uses proportional feedback from his 
auditory system to systematically exercise the neck 
muscles which stabilize his head. (He practices 
with each channel separately before attempting si- 
multaneous control of both axes of tilt.) The senr 



sitivity of each channel can be increased gradually 
to progressively "shape" better and better head 
control. 

Secondary visual feedback is provided via 
four-light emitting diodes, each one representing 
the direction of tilt to which its illumination 
corresponds by its position on the control panel. 
The visual feedback, while not proportional, helps 
the child discover the direction of deviation of 
the head quickly. Those children who can use both 
auditory and visual cues simultaneously generally 
perform very well. An automatic positive rein- 
forcement mechanism incorporated into the system is 
especially valuable for working with children who 
have difficulty understanding verbal instructions 
or who otherwise lack motivation for utilizing al- 
ternate channels for monitoring head position. If 
the head is held within pre-set limits of tilt 
(adjustable to suit the stage of training), a con- 
trol unit actuates a movie projector which displays 
a cartoon for the child to watch. The film drive 
is stopped each time the head tilts too far, and 
re^activated when the head is brought back within 
the desired limits. 

Both line voltage-powered and battery-powered 
versions of the head control system have been de- 
veloped and tested. The latter unit provides only 
auditory feedback, but allows the child complete 
freedom of movement. When the counter with which it 
is equipped is connected to a readout unit, the 
counter displays the total number of pulses accumu- 
lated while the head was tilted too far along 
either axis. Using the couter in the classroom 
will enable us to measure the carry-over of head 
position control learned in therapy sessions. 

Limb Position Monitor 

The limb position monitor (LPM) uses potentio- 
meter-based transducers to measure the angle of ro- 
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tacion about the elbow or wrist joint. The poten- 
tiometers are mounted on goniometers positioned at 
the elbow or wrist joint so that their shaft rota- 
tion corresponds to the angle between the goniometer 
arras. The proportional voltage corresponding to 
the amount of rotation activates a servo motor 
which moves a small dummy arm through the same 
angle (Fig. 2). The child monitors the position of 
his own arm by watching the corresponding movements 
of the dummy arm. A display panel behind the dummy 
arm, in the form of a protractor with the pivot 
point of the joint in question at the middle of the 
baseline, indicates 160 degrees of possible rota- 
tion. 

Initially, the child is asked to move his el- 
bow or wrist joint over whatever range of motion is 
permitted by his innate muscle tone and motor con- 
trol. Smoothness of the movement is encouraged, 
along with stopping the movement at the same upper 
and lower limits each time. Then the child is in- 
structed to move his arm or hand in such a fashion 
that the dummy arm swings smoothly back and forth 
between the extremes of a range of motion which the 
therapist indicates by positioning marker lights in 
any two of the sockets which demarcate 10. degree 
intervals throughout the 180 degree arc. An audi- 
tory signal (a slightly unpleasant sound, so that 
the child tends to avoid rather than promote its 
production) informs the child if he exceeds the 
upper or lower limits of the desired motion . As 
control is gained, the range of allowable motion is 
gradually diminished by moving the marker lights 
closer together. Finally, only one light is left 
on and the child is ins true tiad to keep the finger 
of the dummy arm pointed at that light as long as 
he can. Here the child gains experience moving his 
arm, and in holding the arm still at various posi- 
tions, with accurate visual feedback as to the re- 
sults of his efforts. ^ 

Data Collection > .;v%.v> 

To date, seven children have served as sub- 
jects in the study. Six of these are cerebral 
palsied, of the athetoid type, and one has a bra- 
chial plexus injury due to birth trauma. Of the CP 
children, three are using the LPH; one uses the 
BCD; and two are using both devices. The child 
with the brachial plexus injury is using only the 
LPM; the intent is to encourage her use of the af- 
fected arm by giving her visual feedback about the 
success of her efforts. (The fascination of 
action-at-a-distance seems to make seeing the dummy 
arm move far more rewarding than seeing her own arm 
move.) All of the children have been given 30 min- 
utes of daily ^therapy utilising the devices during 
the school week, in addition to regularly scheduled 
conventional therapy, over periods varying from two 
to five months* 

At present, changes in the amplitude of any 
tremor or oscillation present, in the duration over 
which the child can hold the head or arm station- 
ary, and in smoothness of deliberate movements of . 
various amplitudes are assessed on the basis of 
cinematographic records. The therapists filmed in- 
itial control sessions and re-film the children's 
activities at regular intervals* The therapists 
also keep daily progress notes including objective 
data (sensitivity settings, deviational thresholds, 
duration of holding postures) and subjective com- 



ments (smoothness of movement, muscle tone, pre- 
sence of associated movements and/or drooling). 
Provision has been made for recording analog trans- 
ducer outputs on a strip chart recorder in the near 
future. 

Results 

The films and numerical data show that athe- 
toid CP children can be assisted via mechano- 
electric "artificial sense organs" to gain better 
control over postural stability and voluntary move- 
ment. Duration of holding a fixed posture can be 
increased (in some cases by a factor of two or 
three fold), oscillation decreased or eliminated, 
muscle tone normalized, and smoothness and accuracy 
of movements improved. One child using the wrist 
sensor achieved full joint range of motion with 
normalized tore &y the end of last school year. 

Also, an observation ^hich holds for all the 
children is that while the child concentrates on 
controlling an indiviclual limb or his head, there 
seems to be a generalized lessening of extraner-vi 
associated movements of the rest of the bocl> . 
(This may reflect an increase in sensiti"- '.. ty of 
stretch receptors, permitting better -Jcitrol, due 
to elevated gamma efferent outf Iot' ) In particu- 
lar, movements of the mouth arp .lessened and there 
is less drooling. This effect often persists after 
the end of the therapy session. 

Instances of functional carry-over into the 
classroom of the beneficial effects of treatment 
utilizing these devices have been documented. One 
child, when requested while in speech therapy to 
reproduce the stability of head position which she 
had achieved while using the BCD in physical ther- 
apy, could find and hold the neutral position with- 
out the use of a mirror. Another child made fewer 
errors than usual in depressing typewriter keys 
with the use of a head wand during the ha If -hour 
period immediately following a session of treatment 
using the head control device. 

Future Prolections 

Additional artificial sense organs will be de- 
vised to enable children to monitor, and therapists 
to record and modify, the positions of other body 
parts critical for standing balance and ambulation. 
Devices also will be developed which will reinforce 
the child for bringing several body parts into the 
correct relative positions simultaneously, to teach 
self-feeding and other skills needed for independ- 
ence . 

Depending on the severity of their handicap, 
some children may only require the use of the as- 
sistive devices described here for a period of 
time, and will be weaned from them gradually as 
they learn to "tune up" their proprioceptive chan- 
nels or to monitor limb position via natural alter- 
nate channels* This may not be possible for 
others, who will require the use of similar devices 
on a continuing basis or even as permanent pros- 
theses. 

The devices discussed will be refined in use 
and means of production will be sought to make them 
available to more children in more therapy centers, 
wherever success so warrants. 
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EXCESSIVE NEUROMUSCULAR TIME DELAY AS A POSSIBLE CAUSE OF 
POOR HAND-EYE COORDINATION AND HYPERACTIVITY 



by 

James Morrison 
Applied Physics Laboratory 
The Johns Hopkins University 
Silver Spring, Md. 20910 



Introduction 

It is this writer's opinion that some children 
with learning disabilities (LD children) are suffering 
from abnormally long neuromuscular signal tran- 
sport delays. Smith describes the results of tests 
in which an artificial time delay was introduced in 
the hand -eye coordination feedback loop of ^'normal" 
people (1). Effects of the artificial delay on the par- 
ticipants in Smith's tests are the symptoms of some 
LD children, 

R. P. Rich of the Applied Physics Laboratory 
suggested informally that an abnormally long neuro- 
muscular time delay would show up in the individ- 
ual's simple reaction time and further suggested 
that such measurements be made of LD children. 
The reaction times of some LD children and some 
normal children were subsequently measured. This 
paper describes the result^ and compares the two 
sets of data. Some interesting and pertinent infer- 
ences may be derived froni the results; however, 
the need for further testing is clear. 

Reaction time frequency charts are fitted to 
gamma distribution curves and an accompanying 
supposition is put forth. An important idea regard- 
ing the use of behavior -modification drugs is stated. 

Suggestions for further testing and remediation 
are made. 



Background 

The LD child is one of normal or above -normal 
intelligence who has a handicap that is not of the 
usual or obvious physiological nature and that inter- 
feres significantly with his ability to learn in a nor- 
mal manner. Common disabilities are dyslexia 
(reading disability), hyperkinesis (abnormal amount 
of muscular action), dysgraphia (handwriting disa- 
bility), dyscalculia (arithmetic disability), as well 
as several others. 



Often, learning disabilities are attributed to 
brain injury, prenatal or postnatal. The LD child 
has been given many names of which "brain injured" 
is just one. Altliough hard signs of brain injury are 
not always present, he may still be referred to as 
brain injured. Hence, the following description of 
a brain -injured child applies as well to the LD 
child since he is the one and the same. 



Description of a Brain -Injury Syndrome 

Clements lists ten descriptors for the brain - 
injury (BI) syndrome (2); usually, only a few are 
present in one child. The first, however, applies 
to every LD child (by definition): it states, in ef- 
fect, that the child is of near -normal, normal, or 
above -normal general intelligence and is not gen- 
erally mentally retarded. 

The following symptoms given by Clements ap- 
pear to be caused by retarded neuromuscular re- 
sponse: 

He experiences difficulty in master- 
ing tasks which are dependent upon 
intact visual -motor -perceptual inte- 
gration. 

He experiences difficulty in printing, 
writing, and drawing; he exhibits 
poor and erratic performance copy- 
ing figures and often attempts to ad- 
just to his disability by persever- 
ance and /or meticulous pencil 
strokes, etc. 

He is often generally awkward or 
clumsy in either fine muscle per- 
formance or in overall coordina- 
tion, or both. He may be a victim 
of hyperkinesis or merely restless 
and fidgety; 

He may be highstrung, irritable, or 
have quick changes of emotional be- 
havior from high temper to easy 
manageability and remorse; he may 
be panicked by what would appear 
to others as a minimally stressful 
situation. 

Time Delay Effects on Performance and Behavior 

Reference 1 is a compilation of reports dealing 
with the effects of added time delay on human per- 
formance in a closed 'loop control system. The 
subject performs such tasks as hand tracing through 
a printed maze, drawing geometric figures, writing 
or printing, or speaking. In each case, a transport - 
time lag is artificially added between time of execu- 
tion and the time when the subject perceives the re- 
sult. The delays are achieved by diverse means, 
the most notable being through the use of magnetic 
tape recorders. 
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For hand -eye tasks, the subject writes on a sur- 
face hidden from his view. The writing is viewed by 
a television camera and recorded on magnetic tape 
by a recorder that is capable of playing back the sig- 
nals while in the process of recording. The dis- 
tance between the record and the playback heads, and 
tape speed, produces the time delay. The delayed 
playback signals are viewed by the subject on a tele- 
vision screen. 

When a visual delay as small as 0. 04 second 
was introduced, the general "effect on performance 
was disastrous" (1). The motion pattern became 
inaccurate and disorganized, and the subject often 
showed emotional disturbances and loss of motiva- 
tion. Small time delays seriously affected the neat- 
ness and accuracy of handwriting. As the delay was 
increased, the performance worsened. Errors of 
additions and omissions in writing words were com- 
parable to errors in speech that were caused by de- 
layed auditory feedback. 

The subjects experienced no significant im- 



provement in performance through practice, al- 
though some showed improvement by shifting to 
short, discrete, jerky, "wait-and-see" movements. 
Beyond that, no improvement was derived from 
additional practice. ' 

Interestingly, the subject being tested was not 
aware of the delay, except that^he sensory effects 
were in some way not aligned with his performance, 
and continued performance produced a deterioration 
in perceptual discrimination. 

Comparison of BI Syndrome and Effects of 
Artificial Time Delay 

The behavior and performance symptoms of 
children exhibiting the BI syndrome given earlier, 
and those of normal people when subjected to an arti- 
ficial time delay show a high positive correlation 
and suggest very strongly the presence of common 
causal factors. The characteristics of the syndrome 
and effects of added time delay are summarized in 
Table 1. 



Table 1 

Comparison of BI Syndrome and Effects of Artificial Time Delay 



Normal intelligence 
I 



Dysgraphic Subject 



He cannot perceive the 
origin of his difficulty. 



He has difficulty in draw- 
ing, printing, and writing. 



He often attempts to adjust 
by perseverance and making 
small meticulous strokes. 



He may be high strung or 
irritable and panicked by 
ordinarily niinimally 
stressful situations. 



Normal subject with artifi- 
cial time delay. 



He is not aware of the delay. 



His neatness and accuracy 
of handwriting deteriorates. 



He may show improvement by 
shifting to short, discrete, 
wait-and-see movements. 



He acquires various symptoms 
of frustration such as annoy- 
ance and later apathy. 



ic 



Effects of Drugs on LP Children 

Medication has proven to be effective in reduc- 
ing hyperactivity and irritability and in increasing 
the attention span of some LD children (3). The 
drugs one naively expects to be effective are tran- 
quilizers, sedatives, and relaxants; but they usually 
do not work. For many LD children, these drags 
have actually worsened their behavior problems, 
while stimulant drugs produce some alleviation, an 
effect opposite to that expected. It is noteworthy 
that stimulants can reduce hyperactivity and irrita- 
bility and increase attention span. I would suggest 
that the stimulants reduce the excessive neuromuscu- 
lar time delay present in many LD children. 

Reaction Time Measurements 

Reaction Time Meter 

A simple device was designed and built to ac- 
curately measure simple reaction time, A block 
diagram is shown in Figure 1. 

The functioning of the meter is as follows: The 
operator actuates the reset switchj resetting the 
display, extinguishing the stimulus lamp (if it was 
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Fig. 1 REACTION TIME METER, SIMPLIFIED BLOCK DIAGRAM 
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turned on initially), and starting a sequence that 
produces a randomly delayed pulse. After the de- 
lay, which is less than 1 second, the stimulus lamp 
comes on. Upon recognizing the lamp -on condition, 
the subject actuates a button that is mechanically 
coupled to a crystal phono-pickup. A pulse from 
the pickup stops the clock and extinguishes the stim- 
ulus lamp. The subject's reaction time is read from 
the display. 

Testing 

The subjects were instructed Simply to watch 
the light and press the button as fast possible, 
when the light came on; They were encouraged to 
be poised with a finger lightly in contact with the 
button. Each subject was observed to see whether 
his attention was on the task. Results were ruled 
out when the subject was clearly inattentive. No 
warning was given; however, the wait time was 
never longer than a few seconds. 

Proce&sing and Plotting the Data 

Data have been gathered from 14 subjects thus 
far. Some of the data have been processed to derive 
their means and variances. Frequency plots have 
been made and curve fitting has been done, the re- 
sults of which are discussed under Conclusions . 
Means and variances of the reaction times (B^) of 
the subjects are shown in Table 2. Age, sex, and 
an indication of whether the subject is an LD child, 
a suspected (possible or likely) LD child, or .a nor- 

Table 2 

Listing of Average Reaction Time (Rj.) and 
Standard Deviation {S.D. ) of Various 
Normal and LD Children 



Subject 


Age 


Sex 




S.D. 


Not LD: 










JDM 


15 


M 


0. 221 


0.028 


PK 


12 


M 


0. 210 


0.033 


AH 


10 


M 


0.258 


0.070 


Possible LD: 










EP 


14 


F 


0.261 


0.054 


GF 


14 


M 


0.243 


0. 068 


Likely LD: 










MD 


10 


IVI 


0.317 


0. 139 


SLM 


10 


M 


0. 323 


0.065 


LP 


9 


F 


0.319 


Q.Q64 


DL 


9 


M 


0.341 


0. 100 


PD 


9 


M 


0.349 


0. 112 


SP 


8 




0. 392 


0. 101 


LD: 










KDM 


12 


M 


0. 324 


0, 100 


PT 


8 


M 


0.379 


0,065 


RG 


6 


F 


0. 412 


0. 128 
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mal child are indicated. Also, the reciprocals of 
the mean values are plotted in Figure 2, which shows 
that the mean values of LD children fall into a 
class separate from the others. 
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Fig. 2 RECIPROCAL OF AVERAGED REACTION TIMPS 
OF VARIOUS NORMAL, LD, AND SUSPECTED 
LD CHILDREN 



Characteristics of the Subjects 

Figures 3 through 8 are frequency plots of re- 
action times from five subjects. (Figures 7 and 8 
are plots of data obtained from subject PT under two 
different conditions, as described in the section. Use 
of Stimulant Drugs . ) 

Subjects JDM and AH are both well coordinated 
and high achievers; they are not LD children. 

Subjects KDM and PT are of average or above - 
average intelligence, but have poor hand -eye coordi- 
nation. Both were diagnosed as LD children, and 
placed in special education classes. Subject KDM 
is now in regular class where he is a marginally 
average achiever; he has a low frustration tolerance. 
Subject PT is hyperactive. 

Subject SLM has always been in regular class 
and has above -average intelligence. He has poor 
hand -eye coordination and a low frustration toler- 
ance; he is suspected of being an LD child. 

As shown in Table 2, subjects KDM, PT, and 
SLM have much longer mean reaction times than do 
subjects JDM and AH, the well-coordinated high 
achievers. This fact supports the idea that some 
LD children have poor hand -eye coordination due to 
excessive neuromuscular time delays. 

A comparison of Figures 3 and 5 shows that 
KDM's response is not only slow, but also occurs 
with great variation in the delay. Note that his delay 
varies over a span of 233 ms, a value greater than 
the mean for JDM (a normal youth). 

Implications 

The frequency plots show that there is a large 
constant value (greater than 130 ms) in each reac- 



tion time measurement and that it is different for 
each subject, which would be expected. Since each 
subject tested is intelligent and the children with 
poor hand -eye coordination have long reaction times, 
it is reasonable to speculate that their difficulty is 
related to the longer delays. 
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Fig. 3 REACTION TIME FREQUENCY PLOT, JDM 
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Fig. 4 REACTION TIME FREQUENCY PLOT, AH 
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Fig. 5 REACTION TIME FREQUENCY PLOT, KDM 
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Fig. 6 REACTION TJME FREQUENCY PLOT, SLM 
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Fig. 7 REACTION TIME FREQUENCY PLOT. PT 



Mathematical Analysis of Results 

The shape of the frequency plots fits very well 
the gamma (F) probability density curve, as shown 
in Figures 9 and 10 for the subjects JDM and KDM. 
The distribution is described as follows (4): 



g(t) = 



^r^r-l -at 

Of t e 

r(r) 
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where the expected value (mean) is 
E(t) = vl^. 



610 



(2) 



and the variance is 



(3) 



The parameters a and r were determined from the 
means and variances, which were calculated from 
the collected data. 

The value of r varied from approximately 3 to 
5 for different subjects. However, the value r = 5 was 
used to synthesize the distribution curves, because 
the set of data that produced that value (obtained 
from subject JDM) appeared to be the most reliable. 
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The gamma distribution, Eq. (1), obtains from 
a cascade of exponential distributions (Eq. (4)): 

f{t) = ffe"** (4) 



The gamma distribution, Eq, (1) with r = 5^ is de- 
rived from a cascade of five stages, each stage hav- 
ing an exponential distribution. Each stage has a 
variable time delay that is passed on to the next 
stage where a new time delay begins. Equation (1) 
results from convolving the exponential distributions 
using the equation for the distribution of the sum of 
a finite number of random variables. Equation (5) 
is the convolution equation and is discussed in Refer- 
ence 3. 

f(t) = J g(r)h{t"r)dt (5) 

- CD 

The smooth curves of Figures 9 and 10 were 
generated on an analog computer by simulating five 
exponential functions (Eq. (4)) and using each to 
drive the next. The first function was driven by an 
approximated impulse function (a short pulse) to ob- 
tain the impulse response of the complete chain. 

The time constant of the individual exponential 
functions is equal to n, which was calculated for 
each subject* The shape of the simulated curves fits 
the measured data with unusual accuracy. There- 
fore, it appears that the neuromuscular signal from 
a visual input to a simple hand response may pass 
through live successive stages, each with an expo- 
nential probability time delay as described in Eq. 
(4). 

Use of Stimulant Drugs 

The subject PT receives the stimulant Ritalin 
to help him cope with his difficulties. The medicine 
reduces his hyperactivity, improves his hand -eye 
coordination, and increases his attention span. 



to bring him toward normal. The symptoms of many 
LD children, uninfluenced by stimulants such as 
Ritalin, are remarkably similar to those exhibited 
by normal people after they have received an over- 
dose of barbiturates. These symptoms are described 
in Reference 5, a portion of which is quoted in the 
Appendix. 

Further Work to be Done 

Need for IVlore Data 

Obviously, data from additional LD and normal 
children need to be taken before drawing defnite con- 
clusions in relating hand -eye coordination and hyper - 
kinesis to large time delays. 

More data are needed also to determine how re- 
action times vary with the age of normal children 
and LD children. Follow-up data over a long term 
are needed to determine how an individual's reac- 
tion time varies with his age. 

Other tests should be administered to determine 
the children's output sample rates. A person's 
motorcontrol system does not respond in a continu- 
ous manner, even when tracking a moving target. 
Rather, movement occurs at intervals of about 0.20 
second for normal adults, a time value which is very 
nearly the same as the normal adult reaction time. 
If an LD child displayed sample times shorter than 
his reaction time, his would indeed be an uncertain 
control system. 

Treatment of Data 

Additional data should be subjected to further 
analysis to determine means and standard deviations, 
and to plot frequency graphs. These data could be 
used to help support or disaffirm the supposition 
that some LD children have excessive neuromuscular 
delay, and that this is the root of their problem. 

Remediation 



It is generally reported that the stimulants re- 
duce hyper kinesis by slowing the child down or 
"drugging" him. Two sets of reaction time data 
were acquired from PT, one 3.5 hours after receiv- 
ing 5 mg of Ritalin and the other 0.5 hour after the 
next dose. The results, as shown in Table 2 and 
Figures 7 and 8, indicate a definite decrease (ap- 
proximately 20 percent) in reaction time 0.5 hour 
after taking 5 mg of Ritalin. Possibly a greater 
differential would show up if he were to be off the 
medication for a longer period. Also, the standard 
deviation improved with the medication, providing 
benefits both in improved mean R-y. (reaction time) 
and predictability. 

Subject PT prefers, especially on weekends, 
not to receive the Ritalin. He seems to be happier 
without it. However, his behavior is then unaccepta- 
ble by his parents' standards, and he is less inhib- 
ited. Possibly this child suffers ordinarily from a 
"high" such as normal people experience from an 
overdose of barbiturates and requires a stimulant 



If the difficulty of poor hand -eye coordination is 
shown to derive from abnormally long time delays, 
there are a number of courses that can be pursued 
in helping LD children to learn such skills as hand- 
writing and art. 

Any assistance provided to the child that helps 
him to learn proper handwriting skills will have an 
everlasting effect since handwriting is an over- 
learned skill and, once learned, can be performed 
equally well whether the eyen are open or closed 
(except for gross spatial placements). 

If a stimulant drug were administered to im- 
prove the ability to learn handwriting, it could be 
safely withdrawn when using that overlearned skill. 
The stimulant drug may, however, still be needed 
to reduce frustration and help the child control his 
social behavior and perform physical tasks. Since 
LD children generally, and possibly always, out- 
grow the need for stimulant drugs, their use should 
not be a long-term problem. 
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Computer aids could be used to help overcome 
the time lag while learning handwriting. Some study 
on this matter has been done by the writer and is 
discussed in the next section. 

Reaction time measurements could conceivably 
be used to help determine the amount of dosage re- 
quired to reduce each child's delay sufficiently to 
enable him to learn properly. ^ 

If, indeed, the problem is caused by excess de- 
lay, such children could be taught alternate methods 
and skills. For example, a school of painting called 
pointilism could possibly be taxight some of the child- 
ren. Pointilism utilizes colored dots to construct a 
picture, avoiding the need for the full hand -eye con- 
trol required when making continuous strokes. 

Further Investigations Using Mechanical Aids 

Two methods, both using analog computer tech- 
niques, that speed up writing have been explored. 
One method uses electrical signals derived from a 
mechanized stylus, while the other uses muscle ac- 
tion potentials (MAP). These methods are described 
in Reference 6. Time gains of 30-50 milliseconds 
were made. 

Figures 11 and 12 show, in simplified form, 
how the speeded -up displays are obtained, l^the 
method shown in Figure 11, the stylus is coupled to 
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electromechanical pickup devices that produce ortho- 
gonal voltages. The voltages are sent to a fast- time 
analog simulation where the predictive orthogonal 
voltages X(P) and Y(P) are computed. The signals 
X(P) and Y(P) are used to drive the X and Y axes 
of a storage cathode ray tube (CRT). 

In Figure 12, the input signals to the fast -time 
simulation are derived from MAP signals obtained 
from electrodes on the subject's forearm. 

The method in Figure 11 was fully instrumented 
to produce complete writing. Simultaneous strip 
chart recording of the simulation input and output 
signals indicated a time gain of 30 milliseconds. 

The method in Figure 12 was tested using only 
one MAP pickup; therefore the test was not conclu- 
sive. However, tests using only the one-channel 
MAP signal indicated a time gain of 50 milliseconds. 

Nerve Conduction Velocity 

Direct measurement of nerve impulse conduc- 
tion velocity is possible. This measurement could 
conceivably be used to indicate abnormally long 
neuromuscular time delay when compared with time 
delay measurements of "normal" children. This 
measurement could possibly be used as a diagnostic 
aid as well as a research tool. The writer proposes 
that this measurement be made on some normal and 
LD subjects to see if it is worthwhile pursuing. 

Conclusions 

\t was proposed that some children of normal or 
near- normal intelligence who suffer learning disa- 
bilities, specifically poor hand-eye coordination, 
poss. ss abnormally long time delays in perception, 
cognition, nerve conduction, and /or neuromuscular 
reaction. Such abnormal delays would degrade hand- 
eye coordination, 

A small number of iiormal and LD children were 
tested to determine their reaction times. The mean 
times and standard deviations correlated with 
whether the child was normal or had certain learn- 
ing disability symptoms including poor hand -eye 
coordination. Although the number tested was small, 
the evidence obtained indicates that indeed some LD 
children suffer time delays greater than those of 
normal children. 

The writer feels that sufficient evidence has 
been produced to justify making further measure- 
ments to support the argument or to disaffirm it. 

Also, one h3T)eractive LD child was tested to 
determine the effect of Ritalin on his neuromuscular 
reaction time. The drug reduced the reaction time, 
which seems to refute the supposition that stimulant 
drugs slow hyperactive children, thereby calming 
them. 
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APPENDIX 

Effects of Barbiturates and of 
Another Tranquilizer '^ 

"The authors have been working on moods, 
emotions, and motivations as affected by drug action 
since 1950 and wish to comment (without documenta- 
tion) on the effects of other substances. These ex- 
periments were done on normal humans, aged 21 
and over, and the treatment evaluated while the ^Ss 
were socially active. 

"Three common barbiturates— secobarbital, 
amobarbital, and pentobarbital — have in common 
their ability to cause a feeling of relaxation. In 
many other respects they differ radically. As in the 
case of alcohol, there is often little similarity of 
effect between day-time use and the normal bedtime 
use of sedatives. The effect of Seconal on emotions 
and motivations of the active subject is most promi- 
nent on self-confidence. A 30-50 mg dose enhances 
self-confidence; doses of 100-200 mg cause reck- 
lessness and aggressiveness. Amytal's most signif- 
icant action is on depression of anxiety. At low 
doses the social effects may be desirable; at high 
doses the suppression of anxiety may release hostile 
acts toward others. Nembutal at low doses produces 
a social nonchalance; at high doses it produces silli- 
ness. 

"The effects of Dramamine (dimenhydrinate) on 
the active subject are superficially very like those 
here described for meprofaamate> except that they 
are emotionally probably less pleasant. The effects 
of this drug are more dose -dependent than seems to 
be true of meprobamate. 

"Although the ACL (and other means of evalua- 
tion of drugs in active subjects) shows similarities 
between meprobamate, dimenhydrinate, and seco- 
barbital, they behave differently when they are com- 
bined with amphetamines. Meprobamate plus a'm- 
phetamine yields an effect quantitatively and qualita- 
tively like amphetamine alone, except that it is sub- 



stantially more relaxecl and socially more desirable. 
Secobarbital plus amphetamine tends to emphasize 
the socially least desirable features of each compo- 
nent (self-confidence or recklessness, impulse to 
get socially involved with people while being cheer- 
fully aggressive, and talkativeness). Dimenhydri- 
nate plus amphetamine appears to result in cancella- 
tion of the mood effects of each. " 

* 

Quoted from Reference 5, Cameron, S. J., et al. , ' 
"Effects of Meprobamate on Moods, Emotions, 
and Motivations, " i. of Psych . . Vol. ,65, 1967, 
pp. 209-221. 
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Introduction 

The Electric Pencil provides enhanced auditory/ 
visual sensory feedback to support training in fine 
motor skills in preparation for learning writing 
skills. The Pencil is battery-powered and self- 
contained and is only slightly larger than a primary 
pencil. The user is presented with a work sheet 
with dark forms or letters on a light-colored back- 
ground, and is asked to follow the forms or letters 
with the tip of the Pencil. If the Pencil moves 
outside of the prescribed target area, an auditory 
feedback tone is actuated and remains actuated until 
the Pencil returns to the target area. The addi- 
tional auditory feedback enhances the normal visual 
feedback in alerting the user to the fact that the 
task is not being performed properly. 

It is envisioned that the Pencil may be used 
to train a wide class of individuals. The Pencil 
was originally conceived for use with children with 
poor visual-motor coordination such as children with 
cerebral palsy. However, with little or no modifi- 
cation to the sensory feedback mechanism, the Pencil 
might be used to train sight-disabled, blind, deaf, 
neuro-muscularly impaired, and other handicapped 
individuals without regard to age. 

Description and Use 

Electrical and Electronic Design_ 

Basically, the Pencil detects the amount of 
light which is reflected from the work sheet direct- 
ly below the tip of the Pencil. When the amount of 
light reflected is large (i, e., when the Pencil is 
directly over a light-colored portion of the work 
sheet), the auditory feedback is actuated; when the 
amount of light reflected is small (i.e., when the 
Pencil is directly over the dark target area) the 
auditory feedback is not actuated. Consequently in 
the training in fine motor skills, the normal visual 
feedback is augmented by the addition of the audi- 
tory feedback tone. 

Figure 1 is a photograph of the Pencil. The 
light source, light detector, and the associated 
electronic circuits are housed in the lower portion 
of the Pencil (the portion of the Pencil held by the 
user during training). A ball-point pen is included 
to make a permanent record of the movements of the 
Pencil; the work sheet record is used by the 
instructor in measuring progress. A single 2.7 volt 
mercury cell provides power for the Pencil and is 
housed in the upper portion of the Pencil. A hear- 
ing-aid earphone or transducer mounted at the top 
of the Pencil converts the electrical signals to 
the auditory feedback tone. The Pencil housing is 
nylon. 

Figure 2 is a block diagram of the Pencil, The 
light source is a light-emitting diode (LED) which 
operates in the red portion of the visible spectrum. 
Signals from the free-running multivibrator oscil- 
lator are used to flash the LED. This is done for 
two reasons: 




FIGURE 1, Electric pencil. 
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FIGURE 2. Block diagram of an electric pencil. 



1. It is possible to filter the detected 
reflected light to discriminate against 
ambient light from such sources as over- 
head fluorescent lights or the sun. The 
LED is flashed at a frequency which is 
not a harmonic of 60 Hz. 

2. Power is conserved by using small duty 
cycle (the fraction of the operating 
time during which the LED is on). This 
is important since the LED is the largest 
single power drain in the Pencil. 
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Light from the LED is coupled through a small bundle 
of glass optical fibers to the tip of the Pencil for 
projection onto the work sheet. The fibers are dis- 
tributed uniformly around the annular opening at the 
tip of the Pencil to provide even illumination of 
the portion of the work sheet which is being used. 
In addition, the uniform distribution of fibers re- 
sults in a rotational symmetry for the Pencil which 
means that the operation of the Pencil is independ- 
ent of how the user rotates the Pencil about the 
longitudinal axis. The user may see the light 
emerging from the tip if he looks directly at the 
tip; future models of the Pencil will utilize in- 
frared light sources to eliminate this possible 
source of distraction to the user. 

The light from the Pencil is directed to the 
surface of the work sheet and is then reflected. The 
amount of reflected light is determined by whether 
the Pencil is directly above a light or a dark por- 
tion of the work sheet. Four matched photodiode 
light detectors are positioned symmetrically in the 
annular opening at the tip and electrically connected 
in parallel (again providing rotational symmetry). 
The electrical signal from the detectors is filtered 
to reject unwanted signals and amplified to drive a 
hearing-aid earphone. An auditory feedback tone of 
the same frequency used for flashing the LED is 
generated whenever the Pencil is over a light-colored 
portion of the work sheet. The amplifier and the 
earphone operate in a quasi-linear mode. This means 
that as the tip of the Pencil moves across the 
boundary from a dark area to a light area and the 
amount of light which is detected gradually increases, 
the intensity of the auditory feedback signal grad- 
ually increases to the maximum level obtained over 
a completely light- colored area. This maximum sound 
intensity is sufficiently high to alert the user but 
not sufficiently high to distract another individual 
using another Pencil at an adjacent work area. 



General Information 

The following are general items describing the 
Pencil : 

1. The Pencil is 15,8 cm (approximately 6.25 
inches) long, 

2. The outside diameter of the lower end of 
the Pencil in the area held bv the user is 
16 nni (approximately 0,6 inch); the outside 
diameter of the battery housing is 20 mm 
(approximately 0*8 inch); the outside dia- 
meter of the earphone housing is 24 biti 
(approximately 0,92 inch). 

3. The Pencil weighs 61 grams (approximately 
2.2 ounces), 

4, Proper operation of the Pencil is achieved 
with the longitudinal axis of the Pencil at 
an angle as large as 45 degrees from a 
perpendicular to the plane of the work sheet, 

5, The resolution of the prototype Pencil 
{i.e.» the narrowest target area that can be 
detected) is approximately 6 mm (approxi- 
mately 0,25 inch). This is not an ultimate 
limit for future models of the Pencil, 

6, Mi nature chip resistors, chip capacitors 
and "lid" transistors have been used in the 
prototype model of the Pencil to facilitate 
repairs; future models could use integrated 
circuits. 



7, The mercury cell is rated at 1 Ah. Since 
the Pencil draws approximately 20 mA, the 
cell should provide 50 hours operation with 
continuous use and probably more with inter- 
mittent use. The cell may be replaced 
quickly and easily by disconnecting the 
upper portion of the Pencil, 

Instructional, Materials and Their Use 

Instructional materials may be made with any 
type of light-colored paper stock. The dark target 
areas may be made with a paint brush, felt-tip mark- 
er pens, and with offset printing (except hectograph). 
Any dark color except red may be used since in the 
prototype a red light source is used. Because of 
the wide choice of materials and the ease with which 
work sheets may be prepared, the instructor has 
complete freedom to prepare his own instructional 
materials if pre-printed materials do not suit his 
requirements. 

An individual whose eye-hand coordination 
skills are at a very low level could begin with 
tracinq wide target areas such as broad straight 
lines (see Figure 3), As the individual's pro- 
ficiency at making lines which remain within the 
target area passes a pre-established criterion, the 
width of the area could be decreased. This process 
could be repeated until the narrowest possible tar- 
get area had been reached, A single change in 
direction in the target area could be introduced 
(similar to the letter "L") while reverting to the 
widest target area. Again as the individual's pro- 
ficiency increased the width of the target area 
could be decreased. At this point a continuously 
changing direction (as in an arc) could be intro- 
duced using the same general procedures. The 
individual should now be ready to try to make 
simple letters* 

Test Results 

The Pencil has been tested with one child who 
has cerebral palsy. There were approximately 50 
sessions each of 10 to 15 minutes duration in which 
the child also acted as the control subject. The 
child was presented with 6, 12, and 18 mm wide tar- 
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FIGURE 3. Sample work sheet* 
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TRAINING SESSIONS (or time) 



FIGURE 4, Test data for an electric pencil. 



get areas. The 12 and 18 m target areas presented 
no challenge to the child after the first few 
sessions and are therefore not included in the test 
results. As indicated in Figure 4 (with averages 
of data points) the child's progress followed a 
typical learning curve except for one statistically 
significant difference. Specifically, when the 
auditory feedback was eliminated, the child^s per- 
formance level (as measured by the fraction of the 
time the child kept the Pencil within the target 
area) dropped by approximately 20%, The performance 
level then increased by nearly the same amount when 
the auditory feedback was reintroduced. It must be 
emphasized that these test results are very limited 
in scope, but they do show definite indications that 
the Pencil enhanced the coordination training for 
this child. No comparison was made with this child 
receiving any other type of training with or without 
other training aids. 

Target Populations 

The Pencil was originally conceived for use 
with children with poor visual -motor coordination. 
Without modification, the Pencil could be used with 
sight-disabled or blind children and adults. By 
substituting and/or adding other types of enhanced 
sensory feedback mechanisms (such as tactile or 
visual), it is reasonable to expect that the use of 
the Pencil may be extended to the training of deaf, 
neuro-muscularly impaired, and other handicapped 
individuals without regard to age. 



Future work 



It should be possible to improve the perfor- 
mance of future nx)dels of the Pencil. Resolution 
may be improved t>y moving the light sensor(s) up 
into the body of the Pencil and using additional 
optical fibers to direct the reflected light back 
up to the sensors. In this way the diameter of 
the annular opening surrounding the ball-point 
pen may be decreased by at \east a factor of 
two. This could result in a smaller diameter 
for the Pencil housing. A smaller mercury or 
other type of oower cell moved closer to the lower 
end of the Pencil held by the user would decrease 
the weight and improve the weight distribution. 
While the Pencil is now slightly top heavy neither 
the weight nor the weight distribution appears to 
interfere with its use. It may be possible to 
eliminate the light source and use the ambient light 
in the room; this would »^esult in a significant re- 
duction in the complexity of the electronic circuits 
and increase the battery life. It should also be 
possible to desi^jn a sound transducer which is an 
integral part of the top of the Pencil, thereby 
permitting a reduction in the size of this part of 
the Pencil, It should be possible to reduce the 
cost of the basic Pencil to the range of $10 to $25 
with volume production and appropriate production 
engineering (keeping in mind the rough treatment 
which the Pencil may receive). This would be low 
enough to permit the parents of handicapped children 
to have one of the Pencils in the home to continue 
any training received at school during the day. 
While the Pencil in its present form is most useful 
for training ir^ tracing skills, it is recognized 
that other skills such as copying and drawing letters 
from memory would be important. The use of specially 
prepared instructional materials might facilitate 
this training. Fading cues as a transition between 
tracing and copying letters appears suitable also 
for the Pencil. A simple modification would permit 
the Pencil to operate with the auditory feedback 
tone completely off or on at full intensity (a type 
of bfnary model* With the addition of a switch it 
would then be possible to generate the auditory 
feedback when the Pencil is over either a light or 
a dark area. In this way it would be possible to 
conduct a study to determine whether positive or 
negative reinforcement with auditory feedback is 
more beneficial. 
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THE TUFTS INTERACTIVE COMMUNICATOR 



by 

Richard A, Foulds 
Bio-Medical Engineering Center 
Tufts-New England Medical Center 
Boston, Massachusetts 02111 



Summary , This paper describes an electronic 
assistive device which will allow the non- 
verbal severely handicapped to better communi- 
cate • 



INTRODUCTION 

Everyone has at sometime in his life experi- 
enced the frustration that results from the 
lack of expressive ability. That frustration 
stems from having a mental representation of 
a thought and not possessing the verbal or 
literal ability to express it. This problem 
is of only minor concern to the normal person. 
It is, however, a serious problem to the non- 
expressive handicapped. There are a large 
number of people in our society who are 
physically prevented from communicating any 
original thought because of some ailment 
(either from birth, or as the result of an 
accident). This has severely affected their 
speech, and muscular control. The unfortu- 
nate result of this is that the mind of such 
a person (which is often unimpaired) is 
"trapped** inside the body, with no possible 
means of contact with the world, 

THE COMMUNICATOR 



Chosen as the principle subject in this 
investigation was R,II, a child who is enrolled 
at the Training School in Lawrence, The pre- 
requisite for any form of communication is that 
the patient possess an "intact inner languap.c,** 
This means tliat he must he able to mentally 
organize his thoughts in a fashion which when 
presented will be understood by tliose around 
him, R,H, has this without question. Although 
formal intelligence testing is impossible, R,ll, 
has been psychologically evaluated and is re- 
ported to have a mental age equivalent to his 
chronolc 'ical age, Mrs, Irene Johnson, teacher 
at the Clinic in Lawrence, predicts that under 
the present conditions R,M, should reach a 
fifth or sixth grade reading level by tlie time 
he reaches age fifteen. Presently at age 10, 
he is at a second grade reading level, A fifth 
grade level is roughly equivalent to tl»e level 
at which most common newspapers and magazines 
are written. With this ability, R,II, should, 
given the proper assistive device, be able to 
produce original communication. 



Patient Population 

The patient population which has need 
for such a device consists of any person who 
is severely enough disabled so as to limit 
his physical abilities to a small number or 
grossly controla})le functions, while his men- 
tal abilities remain intact. Ailments such 
as cerebral palsy and multiple sclerosis can 
commonly result in such conditions. In con- 
trast, quadriplegia due to accident allows 
the patient to retain fine control of the 
hand. Speech may also be present in this 
case. The quadriplegic can therefore communi- 
cate using his speech, or written language by 
means of a writing aid. 

The severely involved victim of cerebral 
palsy or multiple sclerosis can not avail him- 
self of cither of these. He has neither speech, 
nor the fine control necessary for currently 
available writing aids. 

The research was conduct^ed by the author 
under the supervision of William S, Crochetierc, 
Ph,D,, Assistant Professor of Engineering Design, 
Tufts University College of Engineering, Clin- 
ical work was performed at tlie United Cerebral 
Palsy of Merrimack Valley Training Center in 
Lawrence, Massachusetts, 



R,ll. 



Age 10 



R,H, is a severely involved spastic- 
athetoid, male child with basically 
spastic lower extremities, and an 
athctoid component in the upper extrem- 
ities. He has some head control, but 
no meaningful speech. Physically, he 
has developed to a 6-month level , In- 
tellectually, he has been tested by 
psychologist at Children's Hospital, 
Boston, and in language development by 
our Speech Therapist; and has been found 
to have intellectual development com- 
parable to his chronological age - 9 
years. He is enrolled at the Special 
Education Classroom at our Clinic and 
attends Classes five days a week, five 
hours a day. 

Disability Profile of Principal Subject 
in this Investigation, 
Table 1, 
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History 



This will provide immediate feedback to the 
operator and also will present information 
for conversation or temporarily store short 
messages • 



The Tufts Interactive Cominunicator was 
developed in the Spring of 1971 by five f»rad- 
uate students in a course in the Department of- 
Engineering Pesii^n at Tufts University. This 
investigator was among those students, and 
Dr. William Crochetiere was the instructor. 

The class was assigned the project of designing panel are three rotary switches. The clock 
and constructing a communicative assist for control gives continuous variation of the 

the severely handicapped. The resultant device, sequencing speed from one second to ten 



The three pushbutton controls on the 
panel are power-on-of f , system, set, and 
dispaly clear. On the opposite end of the 



known as the T.I.C,, allows the user to choose 

and print a character using two signals of the 

same switch. This necessitates only one phy- 
sical movement. 



seconds per step. The Row and Column switches 
control the number of active rows and columns 
on the keyboard. The upper left socket of 
the keyboard is designated as Position 1,1. 
When the T.I.C. is operated with fewer than 
Input devices that were designed, include 64 character cubes, the efficiency of opera- 
head, handwave, and wrist-turn switches. Also, tion may be improved by setting the Column 
an eye movement detector, developed by N.A.S.A,, and Row switcnes to include only those columns 
was duplicated, Tliis, however, has yet to prove and rows which contain characters, 
operational . 

The T,I,C. received national recognition 
when it was awarded the First Prize in the 
Graduate Division of the Annual Creative Design 
Competition sponsored by the American Society 
for Engineering Education. The Competition 
was held at the Society's Conference at Annapolis, 
Maryland in June of 1971. 
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Within the last year development has 
continued as the Master's Thesis topic of 
this investigator. The result is a second 
generation T,I,C. The new apparatus corrects 
the deficiencies of the previous model, as 
well as adds certain desirable features to 
the system. 

Physical Description and Operation 

The Tufts Interactive Communicator is 
shown in Fig. 1, This unit contains tlie 
equipment necessary for communication by 
the handicapped user. Shown is the basic 
T.I.C. with its visual keyboard and 
instrument panel. Parts of the system not 
shown in this photograph are the assortment 
of input devices developed for operator use, 
and the Mite 123T Data Terminal which will 
record on paper all of the characters chosen 
by the operator. 

Visual Keyboard - On the visual key- 
board arc Tnounted two vertical columns of 
indicators. These are designated as the 
cursor and error columns. Spanning the 
distance between these two columns are 64 
sockets arranged in an 8 X 8 matrix. The 
information units (characters and common 
combinations of letters) are each contained 
in a plug-in character cube. Fig, 2. These 
"cubes*' are V* X I" X ZV' relay cases which 
have been adapted for use in the T.I.C. 
These »'cubes" marked with a boldfaced 
character designation, can be plugged into 
any of the 64 sockets , to provide every 
possible arrangement of characters on the 
keyboard. 

Instrument Panel - The lower panel of 
the T.I.C. contains the primary output device 
and the external controls. The output device 
is the Hurrough's Self-Scan display. This is 
an electronic display which will print up to 
16 characters on its screen. These characters 

are 0.396 in. high by 0.276 in. wide (maximum), two and three letter combinations that are 
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Character Cubes - With each character 
or set of characters contained on its own cube, 
any desirable arrangement on the keyboard is 
possible. The circuitry in the cubes is 
designed so that up to three characters may 
be presented on one cube. This provides for 
the output of common combinations of characters 
from only one operator choice. The list of 
characters contained in the T.I.C. is shown 
in Table 2. Included are the alphabet, numbers, 
necessary punctuation and arithmetic symbols. 



used in the teaching of readinp, common letter 
combinations i:sed in communication, and short 
words that are most common in the Ens^lish 
lanfjuape. 

tiardcopy Output - The flite 123T Data 
Terminal- has been chosen to perform the hard- 
copy output function of the T,I,C, The Mite 
123T is not included in the T,I»C. packaf^ing. 
The 123T is contained in its own case and is 
attached to the T.I»C. by means of a cable. 
This will allow the 123T* to be placed anywhere 
in a room. It does not necessarily have to be 
close to the operator. The 123T prints in 
uppercase letters on 8Js" wide continuous roll, 
or fan folded paper. Interconnection is made 
at the rear of both the 123T and the T,I,C. 

Input Devices - The T,I,C. is designed 
to accept any input device which will close 
the contacts of a switch or relay when the 
operator activates that device. All input 
connections are made throu^»h a connector in 
the rear of the T.I,C, The input devices 
which were designed as part of the original 
T.I,C, are still applicable to the new T,I,C, 
Designed as new input devices, are switches 
which utilize motions of the chin and the 
knee. The chin switch is mounted on a pair 
of eye glass frames. The activating bar 
hangs from the switch past the user's face 
and is taped under his chin. Normal movements 
of the mouth will not disturb the switch. 
Only the exaggerated opening of the mouth 
will cause the bar to be pulled low enough to 
trip the switch. The knee switch is designed 
to be mounted under a table or wheelchair 
tray. Lifting the knee from a rest position 
against the switch bar will force that bar 
against a switch that is mounted in the unit. 
The switch bar is padded to prevent injury, 
and spans the width of the table or tray so 
that precise positioning of the leg is not 
necessary. Pressure anywhere on its length 
will cause switch closure. 

The input device is possibly the most 
important part of the system as far as the 
operator is concerned. Without a satisfactory 
means of operating the system, the T,I,C,' is 
practically useless. Due to the variety of 
disabilities of the population of T,I,C, users, 
each operator must be specially fitted with 
his own input device. As was mentioned above, 
the T,I.C, input requirements are relatively 
simple. This allows for use of input devices 
not designed specifically for the T,I,C, 

Operator Usage - Each of the cursor, and 
error indicators, and the character cubes con- 
tains a neon lamp. When the set button is 
pushed, the top cursor indicator is illuminat- 
ed. This remains on until the end of a period 
of time which has been set on the clock switch. 
At the end of the time period, this light is 
extinguished and the next indicator (the 
indicator immediately beneath the first] is . 
illuminated. This sequencing continues down 
the cursor column until the last row (accord- 
ing to the row switch) is reached. When its 
cursor light goes out, the first cursor 
indicator is illuminated. The process begins 
again. 




Character Cubes 
Fig. 2 



Unless the operator intervenes, the 
T.I,C, will idle in the cursor column. The 
operator must choose his desired letter, or 
character combination and wait for the cursor 
light of that row to be lighted, lie then 
sends a command to the T,I,C, via the input 
switch. The T,I,C. will then stop sequencing 
in the cursor column, and begin to step along 
the chosen row, illuminating each character 
cube as it moves. Once the desired character 
cube is lighted, the operator sends a second 
command (identical to the first) and that 
character is stored in the T,I,C,'s memory 
register. 

The T.I.C, thus passes over the remain- 
ing cubes in that row, and illuminates the 
error indicator. If the user knows he chose 
the correct character, he ignores the error 
light. When this light is extinguished, the 
chosen character is simultaneously printed 
on both the Burrough*s Display and the Mite 
123T, The cursor indicator of that row 
again comes on, thus . enabling fhe user a 
scond pass at that row should he desire to 
print another of its characters. The T,I.C, 
resumes sequencing down the cursor column 
until the next command. 

If the user realizes that the character 
he chose was incorrect, he then does not 
ignore the error indicator, but sends a 
third input signal. This negates the choice, 
and causes the characters in that row to be 
sequenced again. 

If the row was accidentally chosen, and 
the user does not wish to print any of its 
characters, he simply ignores the entire 
sequence. The row will be sequenced and the 
T,I,C. will return to idling in the cursor 
column. 
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TAHLi: 



Tlie letter comb inat ions for the class room 
are supplied by Mrs. Irene Johnson, teacher 
at the I.awrence Public School Classroom located 
in the La\vrence CP. Clinic. These are used in 
developing a switten vocabulary by forming words 
by adding letters to the combinations. An 
example of this is - an. Adding letters, this 
becomes; pan, tan, ran, etc. The availability 
of these cubes adds to the use tlic T.I.C. will 
find in the classroom. 
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Circuit ncscription 



Interactive Nature of the T.I.C, 



The circuity of the T.I.C. is contained 
on three circuit boards inside the T.I.C. case 
and in the cubes on the visual keyboard. The 
circuits consist of '*state of the art" com- 
ponents. The logic circuits > which are con- 
tained on the master circuit boards are 
responsible for the sequencin^z and memory 
rcRister functions of the T.I.C. Commercially 
available TTL Logic circuits with complimen- 
tary resistors and capacitors constitute the 
circuit components. The encoding! function 
in the cubes is performed by a transistor 
circuit for each character. Buffering to 
allow the sequencers to drive the lamps in 
the cubes is accomplished by the use of reed 
relays and a transistor driver. 




Rear View of the T.T.r. 



Fig. 5 



Possibly the most important aspect of 
tlie operation of the T.I.C. is its inter- 
active nature. The T.I.C. can be classified 
as a semi-automatic system. The operator is 
in complete command of the thoughts he 
vishes to convey, and the equipment assists 
him, in producing those thoughts in a fashion 
that is understanviable to the people around 
him. The user does not have to provide the 
driving power to the equipment. He is not 
responsible for inputting the codes for each 
letter^ nor is he required to generate on 
his own the options on the visual keyboard. 
On the other hand, the patient is not an 
idle observer who waits until the machine 
presents him with a choice which he can then 
accept, or reject. What the T.I.C. does, 
is allow the operator to direct the machine 
to perform a work task for him. This is a 
direct interaction with the equipment. 

Meaningful written communication 
dictates as much originator control as 
possible, while the physical handicaps 
of that originator call for increased 
external assistance. The interaction 
between the user and the T.I.C. provides 
for operator control of the assisting 
device, and thus serves as tlie link between 
these two constraints. 



TESTING ANn TRAINING 



Input Device 

The success of the T.I.C. is determined 
in a large part by the compatability of an 
operator with his input device. If the input 
device suits the operator, the output of the 
T.I.C. is solely dependent upon the user^s 
ability to express his thoughts by arranging 
characters. If the input device, on the 
other hand, is not suitable for the operator, 
the T.I.C. output will be affected both in 
time and accuracy. 

R.H. was first exposed to electro- 
mechanical communication at the clinic in 
Lawrence where he learned to operate the 
Elcodc, a device developed by Western 
Electric Company. When the original T.I.C. 
prototype was completed, R.If. was its first 
operator. The headswitch appeared to he 
the most convenient of the three operating 
input devices for R.H. Tliis is logical 
since he had been trained on the Elcode to 
use its headswitch. ) 

The immediate results were encouraging. 
R.ll. was able to operate the T.I.C. to the 
extent of selecting letters that were requested 
by an observer. Eventually, the evaluation led 
to allowing him to spell without prompting. 
The words worked on were his name , and the 
names of his two brothers. Continued work 
with the prototype \fas plagued by equipment 
breakdowns. This led to the decision to 
discontinue training or the T.I.C. 



T.I.C. 

Input Voltage - 115 vac (3 pronged socket, 
or acceptable gound) 

Power - 250 watts 

Weight - 30 pounds 

Size - 25 3/4'» high X 18 1/4 

wide X 7 3/8" deep 



Mite 123T (with separate carrying case] 



Input Voltage - 115 vac 
Power - 130 watts 

Weight - 30 pounds 

Size - 7" high X 13'» wide X 18 1/4*' 

deep 

Physical Characteristics 
TABLE 3 
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Before the tests were discontinued > 
certain important information was obtained, 
R.H, response time, which included making 
a mental, selection and a physical input, 
averaged 3 to 4 seconds. This necessitated 
running the equipment at a clock rate of 5 
seconds per stop. Much of this time it was 
suspected was due to tbe inadequacy of the 
headswitch. 

Work on a more appropriate input device 
for R.II, led to the development of the chin 
switch, R,n, had been trained by the therapists 
at the clinic to control the opening? and closinj^ 
of his mouth. This switch utilizes this control, 
The means of testin^^ this device was to attach 
the switch to a battery and light circuit. 
Closure of the switch turned on the light, A 
game was devised which would keep R,H.'s in- 
terest, provide necessary training, and allow 
for record keeping to monitor his progress. 
The game consisted of an opponent verbally 
generating a list of random numbers. On number 
;vas initially determined to be a key number. 
Whenever R,II. heard the key, he was to signal. 
At all other times he was not to turn on the 
light, 

A signal in response to the key number 
was one point for R.H, A signal at any other 
time, or a failure to signal at the key, 
resulted in a point for the opponent. Mrs, H,, 
R,II,'s mother kept most of the records. The 
game was played over a three-month period. At 
the beginning, R.II, A^ron approximately 501 of 
the games. As time progressed, R,H,'s ability 
to use the chin switch imprc ed. By the end 
of the test period, there was hardly any 
contest. R,n, was winning nearly all the games. 
During this period, Mrs. H, began using a 
cardboard replica of the visual keyboard, 
Mrs. II, simulated tlie T,I,C, by pointing, and 
R.il. indicated his choices by turning the 
light on and off. 

While working with R,H. this investigator 
found that the subject had excellent- control 
of his right knee. This is to say, that he 
could lift his knee, from the hip, and bang 
it on the underside of the table. His response 
time for the physical motion was in the range 
of 1 second. Prom this discovery, the knee 
switch was developed, 

A prototype knee switch was built and 
brought to the clinic. Fay Kimball began to 
train R,H, on this device during his therapy 
sessions. A second switch was built and 
installed in R,M,'s home, A code was devel- 
oped for basic communication. Two switch 
closures, or two light blinks indicated yes , ^ 
and one indicated no. 

The therapy sessions consisted of one 
hour each week with Mrs. Kimball simulating 
the keyboard on a blackboard, and R.II. 
indicating his choices by closing the switch. 
The game was discarded since R.II. lost interest 
nfter only a few attempts with the knee switch. 
He rarely missed and did not feel the sense 
of competition. For three months Mrs, Kimball 
kept records of the response time for the 
selection of letters which were used in 
forming words which were then being simultaneous 
taught in the classroom. The data compiled 
by Mrs, Kimball is shown in Table 4. 




Knee Switch location 



Fi?,4 





Average time 


Number of 


Date 


Per Response 


Responses 


1/12/72 


2,3 seconds 


13 


1/26/72 


2,3 seconds 


22 


2/2/72 


2 , 4 seconds 


48 


2/9/72 


2,0 seconds 


27 


2/15/72 


2 , 1 seconds 


19 


2/16/72 


1,3 seconds 


24 


2/22/72 


1,4 seconds 


25 


3/1/72 


1.5 seconds 


31 


3/29/72 


1,1 seconds 


14 



Summary of Results of Knee Switch Evaluation 
TABLIi 4 



The results in the table above are not 
to be taken as a quantitative measure of R,]I, 's 
improvement. There are too few trials for the 
data to be taken exactly. The results do 
show an improving trend. What can be gained 
from this, is evidence to support the theory 
that practice will improve time response to 
some extent. This extent is not, however, 
measurable at this time . 

Toys 

In order to provide increased practice 
with the knee switch, a line of toys was 
developed. Each toy, is operated by an input 
from the knee. These toys were designed and 
built by the students enrolled in E.S. 001, 
Section B, Design Grapliics, a freshman course 
in the Tufts College of that section. Hleven 
toys were constructed. Two of these were 
ly given to R,H. immediately, while the remaining 
are awaiting minor modifications before they 
can be used, 
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KeyhoarU Optimization 

Another area in viiich evaluation is heinp 
performed, is that of visual keyboard layout, 
Mr. Jon Mead, graduate student in the Hepartment 
of fingincering licsi<:n at Tufts University, has 
written a computer prof^ram which will simulate 
t)ic operation of the T.I.C, U'ltli this, he can 
evaluate different character arrangements. His 
evaluation criterion is the number of steps 
between character choices. 




Training Session At the Clinic 



FiR.5 



CONCLUSION 



The work on the T,I,C, has not come to 
an end. There is still a f;reat deal left to do, 
JJepending upon the outcome. of the evaluation 
of the visual keyboard, the T,I,C, logic 
circuitry may be modified to accomodate the. new 
method of operation. The addition of a small 
electronic calculator would eliminate the 
drudgery of long mental arithmetic calculations. 




Patient Evaluation 



Fig, 6 



Smaller additions whicli would add to the con- 
venience of the handicapped user are non- 
printing character cubes such as, linefeed 
carriage return for the Mite 123T, display 
clear for the Hurrough^s display, and a bell 
signal to call someone to read a written 
message , 

Hach user will have his own special 
needs. Once these needs have been determined, 
special purpose cubes can' be built to provide 
for common two and three letter combinations 
that are useful in liis life. 

The T,I,C, that is now being evaluated 
will become the property of R,n, Only in this 
way, with the T,i,C, becomin^p, an intei;ral part 
of the user's life, can a proper evaluation be 
completed, R.H, is predicted' to reach an 
eventual fifth or sixtli grade reading level . 
This is sufficient to satisfactorily communicate 
using the T,I,C, It is hoped that through use 
of the T,I,C, this level will be rcached'at an 
earlier time in his life. The T.I.C. may even 
allow R.ll, to progress to a higher reading 
level. This is all entirely possible. 

The continuing design must lead on to 
a larger realm. Communication is essential 
to all persons, even the severely handicapped. 
Once the T,I,C. has been fully evaluated, effort 
should be made to correct its deficiencies and 
find a means of making it available to the 
handicapped population. 

This work has changed the life of one 
child* It has given him the potential to un- 
lock his mind and become a creative part of 
society. This in itself is reward enough for 
this investigator, But, if one child can be 
helped, so can many more. There is indeed 
a great deal left to do. 
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PRACTICAL AIDS FOR NON-VERBAL HANDICAPPED 



by 

Ora May Rice Robert G. Combs 

Woodhaven Learning Center University of Missouri-Columbia 

Columbia, MO 65201 Columbia,' MO 65201 

Suimnary . An electronically simple communication system, which was 
developed for use by non-verbal handicapped, was evaluated to de- 
termine its effect on speed and reliability of communication in 
three different environments: (1) a formal testing situation 
where the French Pictorial Test of Intelligence was being adminis- 
tered; (2) a typical classroom situation; (3) a social or non 
classroom condition. When compared with their usual mode of com- 
munication, the use of Myocom measurably increased the speed and 
accuracy of response for each of the six subjects evaluated. 



Introduction 

In 1968, the Department of Electrical Engineer- 
ing at the University of Missouri-Columbia and the 
Woodhaven Learning Center (then called the Woodhaven 
Christian Home for Exceptional Children) began a 
cooperative bioengineering program whose object was 
to solve many of the unique problems associated with 
education and training of physically handicapped, 
mentally retarded individuals. The first problem 
attacked was finding a convenient, reliable mode of 
communication for those who could not speak or util- 
ize the conventional modes of writing or typing. A 
system was conceived, designed and developed which 
used surface myopotentials for actuation by elec- 
tronically converting these signals into a control- 
lable dc voltage. This basic system was dubbed Myo- 
com(l) . 

Continued technical development and on the job 
qualitative evaluation of the system convinced the 
project team that Myocom was more than an interest- 
ing toy. We decided to put our intuitive convic- 
tions to the test of a controlled, quantitative 
evaluation. 

Areas of Evaluation 
Intellectual Abilities 

No meaningful educational program for an indi- 
vidual can be planned and implemented unless some 
measure of intellectual abilities is known. Several 
generally accepted "standardized" tests are avail- 
able for achieving this determination on normal in- 
dividuals. As the degree of abnormality increases, 
however, the availability of valid test vehicles 
drastically decreases. Since the non-verbal, physi- 
cally handicapped, mentally retarded individual is 
near the extreme in abnormality, the most usual mea- 
sure of intellectual ability is an intuitive, edu- 
cated guess as to the probable score on some stan- 
dard test. Difficulty of communication is more than 
likely the underlying problem. 

The French Pictorial Test of Intelligence is 
used as an evaluation vehicle at Woodhaven. This 
particular test gives information on picture vocabu- 
lary, form discrimination, information and compre- 
heijsion, similarities, size and number, immediate 
recall. Total number of responses and number of 
correct responses within a fixed time period is the 
basis for score on this test so rapid, reliable com- 
munication is essential for any meaningful evalua- 
tion. 



Performance in Classroom 

Fart of the educational process at Woodhaven is 
participation in a typical classroom environment. 
Although the student to teacher ratio is normally 10 
to 1 or less, the diverse degrees of handicap put a 
premium on rapid, reliable communication if the 
teacher is to give each individual the necessary 
personal attention. Also, the teacher must have an 
effective way of assessing whether each individual 
has achieved a particular instructional objective. 

The Social Situation 

Several types of social intercourse were used. 
For example, use of basic forms of courtesy and 
choice of proper clothing were two of the areas in- 
volved . 

Gathering the Data 

How 

In all cases, the raw data was obtained from 
direct observation by a third party. Response time, 
for both usual communication method and Myocom com- 
munication, was the time ^lapsed until the teacher 
decided that the response was satisfactory. Twenty- 
five observations were made for each condition and 
an arithmetic average determined as the measure for 
response time . 

On Who 

Dennis - age 12, right side bilateral hemople- 
gia with seizure disorder. Normal mode of communi- 
cation is limited verbalization. 

Randee - age 17, mixed type cerebral palsy. 
Normal mode of communication is limited verbaliza- 
tion. 

Sydney - age 13, cerebral palsy with auditory 
difficulty. Normal mode of communication is ges- 
tures . 

Joey - age 1/i, paraplegic, spastic cerebral 
palsy. Normal mode of communication is limited ver- 
balization. 

Carol - age 2^, severe spastic auadraplegia . 
Normal mode of communication is by movement of eyes. 

Larry - age 2^, condition never really diag- 
nosed. Normal mode of communication is labored ver- 
balization plus his own special gesture system. 
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Results 

French Pictorial Test 

Dennis . Previous estimates of Dennis' I.Q. had 
been madei for example at age 8, a guess of 25 was 
based on observation; at age 9, partial testing gave 
an estimate of 28; and at age 10, further testing 
refined this to 37. At age 12, using the full scale 
test and Myocom, an I.Q. of 47 was obtained which is 
at the upper end of trainable. 

Randee . At age 7, an approximation based on 
observation gave an I.Q. of 57. By age 10^ this 
approximation had dwindled to 40; however, two years 
later an estimate made from a partial test was 41. 
The full scale test using Myocom gave a measurement 
of about 30, which placed Randee midway in the 
trainable mentally retarded range. He made 180 re- 
sponses to test items within the hour with 3 seconds 
being quickest and 15 seconds being longest. 

Sydney . It was estimated that Sydney lacked 
the ability to score at all when he was 9, indicat- 
ing that he was in the custodial range. At 11, the 
same estimate was made. The full scale test with 
Myocom gave a measured I.Q. of 35. 180 responses 
were made within the hour limit with 3 seconds the 
minimum time and 12 seconds the maximum. 

Joey . Joey was believed to be unable to score 
at age 8. Closer subsequent observation estimated a 
score of 30 and a partial test at age 10 raised this 
to 42. A definite 44 was obtained from the full 
scale test using Myocom which puts Joey at the upper 
end of trainable mentally retarded. 160 responses 
in 45 minutes is the base of this measure. 

Carol . No estimate of I.Q. was made on Carol 
until age 17 when an approximate 33 was given. At 
I8t further observation guessed that a 45 was possi- 
ble. A few test items were used at 19 and this re- 
fined estimate gave at least 39 which seemed to be 
confirmed at age 21 when some other test items gave 
a 40. The full scale test, with Myocom, was admin- 
istered at age 24 and resulted in an I.Q. of 67, 
which ranks Carol in the educable mentally retarded 
range. This measure came from 180 responses within 
the hour limit with 3 seconds and 20 seconds being 
minimum and maximum response time respectively. 

Larry . The previous history on Larry's I.Q. 
score is a guess of 32 at age 17, no measurement 
possible at age 19, and at age 22, a partial test 
showed an I.Q. of about 45. By responding 145 times 
in 30 minutes (3 seconds min. , 9 seconds max.) the 
full scale test showed an I.Q. of 40, the upper end 
of TMR. Table 1 concisely summarizes these results. 



Previous 

Name Estimates of I.Q. 

Dennis 25, 28, 37 

Randee 57, 40, 41 

Sydney 0, 0 

Joey 0, 30, 42 

Carol 33, 45, 39 

Larry 32, 0, 45 



Full Scale 
Measure of I.Q. 

47 
30 
35 
44 
67 
40 



Table 1. 
Response Time in Classroom 

Dennis . An average of 10 seconds (25 responses) 
was required to respond doing numerical work when 
Dennis used his normal method of communication. Use 
of Myocom reduced the average to 6 seconds. 

Randee . For Randee doing numerical work -using 
his gesture system to communicate, an average of 12 



seconds response time was required. With Myocom the 
average was 10 seconds. In a reading situation, 
"normal^' response was 10 seconds while Myocom re-' 
sponse was 6 seconds. 

Sydney . Responding to numerical work was very 
difficult for Sydney with as much as 3 minutes re- 
quired for a satisfactory response using his usual 
mode of communication. The most rapid was 12 sec- 
onds. Ten seconds was the 25 response average using 
Myocom. 

Joey . Myocom reduced the average response time 
In a general classroom sit\iation from 10 seconds to 
^ seconds. For numerical work the reduction was 
from II to 6 seconds. 

Carol . It took Carol an average of 10 seconds 
to satisfy the teacher with her eye movement system 
when responding in a reading situation. Myocom re- 
duced this to a 3.6 seconds average. For numerical 
work 12 seconds were required with eye movement and 
3.5 seconds for Myocom. 

Larry . No measurements made. 

The Social Situation 

Table 2 summarizes the results of measuring 
response time in a social situation. 





"Normal" 


Myocom 


Name 


Response Time 


Response Time 


Dennis 


9 sec. 


4.5 sec. 


Randee 


10 sec. 


4.0 sec. 


Sydney 


10 sec. 


6.0 sec. 


Joey 


8 sec. 


3.0 sec. 


Carol 


8 sec. 


3.0 sec. 


Larry 


no measure 





Conclusions 

The quantitative results of this study pretty 
much speak for themselves. A measured value of I.Q. 
was obtained for the first time on each of the par- 
ticipating individuals. It was shown for all but 
Larry that a more rapid means of communication was 
available for use in the classroom and out. The 
feeling of the professional staff involved was that 
reliability was much improved also. Other observa- 
ble effects were lessening of frustration and spas- 
ticity when communication was improved and increased 
involvement in classroom activities concommitant 
with better communication. 

Several intangible benefits were "obvious" to 
those participants from the professional staff. For 
example, the handicapped individuals seemed to get a 
psychological uplift from knowing they could communi- 
cate more rapidly and accurately. The instructional 
staff felt that a more realistic and useful course 
of study or training could now be prescribed for the 
student. We don't believe that all of this can be 
attributed to the halo effect. 
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A C0M>fl'NICATIONS PROSTHESIS FOR A QUADRIPLEGIC 



by 

Howard B. Johnston Jr., Richard P. Manning, and Joseph S. Lappin 
Vanderbilt University 
Nashville, Tennessee 



Introduction 

Quadriplegics and other persons with lijnited 
motor control who are also non-verbal need a 
substitute for the normal verbal communication 
system. Some of the general aspects of the com- 
munications prosthesis design problem is selection 
of the subject-to-device interface, selection of 
input code symbols and output character sets, 
selection of the output device, and the specific 
logic design. A specific prosthetic device for 
a quadriplegic is described. 

Interfacing to the Subject 

Selecting Muscular Responses 

In designing a prosthetic device to expand 
the communications ability of non-verbal subjects, 
one of the most iitportant problems is interfacing 
the subject with the device. The initial step in 
solving this problem is to evaluate the subject's 
muscular control. This may be as simple a task 
as talking to the subject^ s family and physical 
therapist, or it may require extensive testing 
and training in conjunction with physical therapy. 

ringer, hand and arm movements; eye and head 
movements; foot movements; and breath control are 
some of the muscular responses which have been 
used for applications of this type* There is 
some feeling that hand movements should be 
employed wherever possible (1). This does have 
the advantage of easing interface design. 

Selecting Input Detectors 

At the same time the subject's muscular 
control is being evaluated, the device to trans- 
late the movements into electrical signals must 
be designed- This must also be tailored to the 
subject; the speed, accuracy, and strength of the 
subject's motions must be considered. 

For example, one of our subjects, a 26 year 
old female quadriplegic, has already been trained 
to communicate using head movements and Morse 
Code. Among the interface methods which were 
considered were: a pair of glasses containing a 
focused light source which she could direct at 
two photo-cells; bio-electric detectors to 
receive signals from her neck muscles; magnetic, 
optical or rf systems to detect her head 
position. 

The system that is being used consists of 
two micro switches with 12 inch fiberglass . 
levers, mounted by goosenecks to the back of her 
wheelchair. This solution has a number of 
advantages over the others considered. First, 
the use of fiberglass levers makes the system 
very safe electrically; also the lever's flex- 
ibility and padded ends virtually eleminate any 
possibility of injury. The cost of the switches 
is low J but the system is reliable. The goose- 
necks allow easy adjustment of the switches by 



her family. The system has a very low activation 
energy due to the use of micro-switches. Finally, 
no direct attachments to the subject need be made. 

Input Code Selection 

The first problem associated with chosing the 
input code is the selection of the number of 
symbols it employs. This choice is affected by 
two considerations: (1) the number of distinct 
motions the subject can control, and (2) the 
number of input symbols the subject can learn to 
use. 

In normal individuals, it is probable that 
the ease of learning and speed of communication 
are increased as more input symbols are used in 
the input code. This is true for input codes that 
have a relatively small number, about 40. of 
associated outputs. For example, many people can 
type more than 50 words per minute, which is 
considerably faster than can be achieved using 
Morse Code. 

In the case of the previously discussed 
subject, communication by spelling using Morse 
Code was a good choice. If she had had more 
muscular control, a code using three, four, or 
more switches could have been used. 

U'hatever input code is used, there are two 
important factors in selecting the assignment of 
input code words to output sjmibols: First, the 
code words should be designed to take advantage of 
the frequency of occurrance of the output symbols. 
Second, there must be input code words which 
control the output device (carriage return, space, 
erase, etc.) or other devices (television, radio, 
etc.). These two factors are virtually indepen- 
dent of the intellectual development of the 
subject and should always be considered in 
choosing an input code. 

In the case of subjects of low intellectual 
capability, the difficulty of memorizing input 
code words suggests two l^es of input codes. 
These codes are characterized by the kind of feed- 
back, memory of previous input S3mibols, and a 
graphic display of the code itself. 

In one type of code, the input switches have 
a one-to-one relation to the output characters and 
are marked accordingly. The markings form a 
graphic display of the code and the subject merely 
needs to find the switch marked with the desired 
character and press it. This method can be 
extended to systems with fewer switches than 
Symbols by using a scheme similar to the operation 
of the shift key of a typewriter. 

An alternative code, for use by persons with 
limited muscular control, uses only two switches. 
When any character in the display is lighted, one 
switch would cause the character to the right to 
be lighted, and the other switch would cause the 
character below to be lighted. In effect the 
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subject causes successive characters to be lighted 
on the display until the desired one is reached. 
The symbols could also be arranged in a tree 
structure and the switches would determine whether 
the next light was lighted in the right or left 
branch. Obviously, these methods can be ©ctended 
to more than two switches. Note that the *^tree^^ 
structure is more efficient than the ''right-down" 
moving metho*^! , since the "tree*^ structure results 
in shorter average path lengths. 

Outpuv Characters 

The set of output characters is determined in 
part by the user's intellectual development. In 
the case of intelligent, educated subjects, spell- 
ing is probably the best communications method. 
Spelling provides a large vocabulary but requires 
only a relatively small number of output charact- 
ers. Alternatively, character sets can be 
designed to represent con5)lete words or concepts 
with a simple character. Such a system could be 
easily learned and should, therefore, be much more 
usable by young, uneducated or retarded subjects 
(2). Hieroglyphic characters with meaningful 
shapes are being used successfully by researchers 
at the Ontario Crippled Children's Center (3,4). 

Output Devices 

Output devices fall into two catagories — 
hard-copy units similar to typewriters, and soft- 
copy displays of various types. In general, 
hard-copy devices have advantages in permanancy of 
record and longer character strings. On the other 
hand, soft-copy devices enjoy advantages in cost, 
maintenance, portability, and size of character, 
sets. 

Of the available hard-copy units, one of the 
most practical is a standard ASR33 teletype which 
costs about $1200 and will accept standard ASCII 
code. It is also computer-compatible which could 
permit the use of con5)uter- assisted training 
programs. Its major disadvantages are noise, 
short life span, and small character set. 

The cheapest hard-copy unit consists of a 
standard electric typewriter with the keyboard 
switches paralleled by switches in the communica- 
tions device. Not only is the cost of the type- 
writer and interfacing small, but since it can 
still be used as a typewriter, it serves a 
double purpose. 

More expensive teletypes and modefied IBM 
Selectric Typewriters are priced from $1800 to as 
much as $4500. Their advantages are primarily in 
the areas of higher reliability, less noise, and 
greater portability. A difficulty suffered by 
some of these devices is their use of non- 
standard input codes. 

Soft -copy devices are generally better, but 
suffer from the lack of a permanent output record. 
The simplest soft-copy unit is capable of dis- 
playing only one character at a time, but is by 
far the least expensive and most flecible display 
device. An exan^ile of this device as presently 
being used consists of 62 individually lighted 
slides: 26 letters, 10 numbers, and 26 punct- 
uation marks, special characters and commonly 
needed words. By changing the set of slides this 
aparatus can easily and cheaply be converted to 
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any set of output characters. 

Soft -copy devices which are presently being 
evaluated include multiple character displays of 
three types. First, displays are available from 
the Burroughs Corporation which are capable of 
displaying as many as 256 characters at a time. 
Their cost ranges from $260 for a 16 character 
display to $1100 for the 256 character \mit. These 
devices accept a seven bit ASCII code and include a 
blanking or erase function. They have the advant- 
ages of low cost and small size. 

One could build his own 10 or 20 character 
display employing 5x7 LED (light emitting diode) 
readouts. Not only could this unit be compatible 
with the Burroughs device, but it could be capable 
of a larger character set (e.g. heiroglyphics). 
Such a unit would cost more in single quantity 
purchases, but the additional expense can be 
defrayed by quantity buying and by the increased 
fLexibility. 

Finally, the use of CRT (cathode ray tube) 
displays is being considered. This approach has 
the advantage of the largest character set , but is 
also the most expensive and least portable soft- 
copy unit. The availability of Read Only Memories 
(ROM) for character generation and low cost 
oscilloscopes make this approach worth investigat- 
ing, but the final trade-offs have not yet been 
evaluated. 

Two general advantages of soft-copy units 
concern feedback and visibility. Soft-copy 
displays typically provide better feedback to the 
subject, since intermediate states can be display- 
ed. Often the hard-copy unit will not be vis able 
to the subject and he must depend upon other |)ersons 
for correction. Also, the soft-copy units have a 
greater vis ability. While it is difficult for a 
large number of people to stand around a type- 
writer to read what is being typed, soft-copy 
displays can be placed so as to provide viewing to 
a large number of people. 

Design of the Prosthesis 

The prosthesis itself should satisfy several 
conditions. First it should be small, light- 
weight, portable, and possibly battery operated — 
these conditions are especially important in the 
case of ambulatory subjects. Second, it should be 
inexpensive, reliable, and easy to maintain. 
Finally, it should be adaptable to a large variety 
of input codes and output character sets — the 
wide range of motor capabilities and intellectual 
development found in persons possessing no verbal 
ccMnmunications abilities make it difficidt to 
employ one standard input code and output character 
set for all subjects. 

Low cost and low power consumption can be 
achieved by employing integrated circuits (IC's). 
They are physically small and result in relatively 
lightweight units. Integrated circuit systems are 
also very reliable and efisily maintained. 

The adaptability of the device to variations 
in input and output character sets is determined 
by the logic design employed. Each input symbol 
is considered to be a single binary signal. One 
approach is to design a sequential machine whose 
outputs are equal to the machine's states. For 
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the example of Morse Code input, the device v?ould 
be designed so that after eacli input, the values 
of seven flip-flops would equal the desired output 
code, e.g. ASCII. This approach would require a 
large number of logic gates (30 to 50 TTL IC 
packages) and any change in the input code or 
output character set would require a complete and 
lengthy redesign. If the device were to be 
produced in very large quantities, though, one 
might employ a single Texas Instruments program- 
mable logic array (TI TMS 2000 JC) (5). This is 
a 40 pin IC, which is programmed by the manu- 
facturer to the customer's specifications. . It 
contains 8 J/K flip-flops and a significant 
quantity of And/Or gating for realizing the J and 
K inputs. 

A second appr'.>ach, the one we prefer, is to 
convert the input symbol strings into a unique 
n-digit binary code, and then, use a Read Only 
Memory (ROM) to convert this code into a more 
standard one, e.g., ASCII, EBCDIC, or IBM Se- 
lectric code, or to perform a direct conversion 
to 2" outjiuts via a matrix or grid decode struc- 
ture. Such a situation is represented in Figure 1. 

Morse code with a maximum string length of 
five symbols is the input. The presence of a dot 
is stored in the shift register as a zero and a 
dash is stored as a one. At the end of a 
character a unique six-bit binary number resides 
in the shift register. Note that the sixth bit 
is necessary since this is a variable length code. 
Two 3-to-8 decoders are used to produce an 8 x 8 
array. Each of the possible 64 outputs is decoded 
by the coincidence of any row line and column line. 

An Intel 1701 programmable and erasable ROM 
is employed to perform the code translation re- 
quired to produce ASCII or any other codes (6). 
This ROM, which costs about $100.00, is extremely 
flexible since it can be erased by exposure to 
ultraviolet light and can be re programmed. 

The logic design displayed in Figure 1 re*- 
quires very few lC*s. For the 64 character display, 
about 24 IC packages are required. If teletype 



output is included, then the ROM and a })arallel- 
to-serial converter (about five additional IC 
packages) are required. 

Interfacing to other output devices, e.g., 
an I13M Selectric typewriter, 5x7 LKD readouts 
or CRT displays, can be achieved easily by the 
use of standard ROM's for conversion from ASCII 
to the required injmt codes. 

Conclusion 

The genera] problem of choosing input and 
output symbol sets is not a trivial one, 
especially when ease of learning and speed of 
operation are important. This problem is com- 
pounded with the need to evaluate the subject's 
individual motor control and intellectual develof)- 
ment . 

The communications prosthesis must provide 
the subject with an effective method of communi- 
cating his thoughts to others. Given that the 
appropriate input and output symbol sets have been 
chosen, a relatively low cost prosthesis can be 
built using medium and large scale integrated 
circuits. The major cost of the device is due 
mostly to the output device chosen* 
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APPARATUS ACTUATING AND CALL SYSTEM 
FOR INCAPACITATED PATIENTS 
by 
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and 
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Summary . This paper describes a system which en- 
ables a severely disabled person, particularly 
the high level quadriplegic, to call attention 
of attending personnel at home or in a hospital 
and to operate such electrical appliances as a 
heater, lamp, air conditioner, radio, television, 
an electrical door latch, or to answer the 
telephone. The only physical requirement on 
behalf of the patient is to gently nudge or 
puff on a sensitive rnicroswitch . 



Introduction 

A small group of highly incapacitated patients 
cannot utilize the existing call systems for com- 
municating in hospital; particularly spinal cord 
injured with high cervical (neck) injury, bulbar 
polio or Guillian-Barre syndrome. They frequently 
roust remain passive and totally dependent on the 
frequency of visits by the nursing staff for their 
most vital or trivial needs. The demands on the 
nursing staff are great. The system described 
here helps both the patient and the nurse to deal 
with these dependent situations. It allows the 
disabled patient to reach a nurse at his will like 
any other patient. It also allows the patient to 
control several electrical appliances from his 
bedside and to answer the phone. The equipment is 
self-supported, requires no special installation 
and plugs into the existing hospital call system. 

System Description 

The system is comprised of four components 
as shown on the block diagram and photograph. 
These are; 

1. A microswitch with appropriate support. 

2. A case containing the electronics. 

3. A numerical display. 

4. A telephone answering attachment. 

The parts are interconnected with cables and plugs, 
thus allowing easy transporting and refitting when 
necessary. 

The selected microswitch has an actuating 
lever with an operating force of only two grams. 
A transparent plastic card or sail is attached to 
the actuating lever. Other activating means for 
switching electrical circuits were considered and 
discarded for reasons of inconvenient operation, 
complexity and cost. Among these were voice switch- 
ing, and interrupting of an air stream (pressure 
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switch) . The support for the switch allows easy 
positioning at any place and orientation as needed 
by the patient position. It is mounted on the head- 
board of the bed and can be swung aside to allow 
unobstructed access to the patient. It may be 
preferable to have a separate stand by the bed 
similar to a microphone stand for completely inde- 
pendent support. It takes a slight puff to cause 
movement of the actuating arm and make contact. 

The electronics case contains a step down trans- 
former, a D.C. power supply, a motor-driven four- 
deck rotary switch, a set of latching relays, con- 
trolled electrical outlets and a jack for the 
telephone attachment. 

The numerical display is attached to the micro- 
switch support in line with the roicx'oswitch, with- 
in view of the patient. The numerali^ 1 through 9 
are approximately a half inch high. 

The telephone answering attachment is comprised 
of a metal box which fits over the cradle of the 
telephone apparatus and is secured in place by 
means of a bracket under the telephone set. A DC 
solenoid is mounted inside the box and a dead 
weight bar is attached to the solenoid plunger. 
The telephone receiver is placed in the cradle of a 
telephone loud speaker device. 

System Operation 

The system is activated by gently blowing on 
the microswitch. This starts a slow sequence. 
Numerals which correspond to the numbered electri- 
cal outlets appear on the display at 10 second 
intervals. The status of any appliance plugged 
into a certain outlet can be changed from "on" to 
"off** or vice versa if the microswitch is activated 
while the corresponding number appears on the dis- 
play. Number 1 would be normally assigned to the 
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FIGURE J. Block diagram of the actuating system. 



nurse call, number 2 for answering the telephone, 
and the electrical outlets will be numbered 3, 4, 
5, etc. The switch of each electrical appliance is 
left in the "on" position while the actual switch- 
ing is performed in the case. The switching cir- 
cuit is relatively simple. Deck number 1 on the 
rotary switch is allocated to driving the motor. 
All the contacts except the starting position are 
shorted and connected in series with the power 
supply and the motor. Deck number 2 is the sequence 
starting deck. The starting position is connected 
in series with the motor and the power supply 
through the microswitch^ When the contacts on the 
microswitch close this deck will supply, the motor 
until the wiping arm makes contact on deck number 
1. Each position on deck number 3 is connected to 
a latching relay. The contacts of each relay are 
connected to an electrical outlet on the case with 
113 volts supply in series. With each additional 
pulse the contacts •*make'* or "break" , thus ener- 
gizing or de-energizing the outlets. A pulse is 
generated when the micro switch^ which is discon- 
nected now from the motor-driving deck} is closed, 
making a circuit from the power supply through 




FIGURE 2. The four components which 
comprise the call system. 
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the wiping arm of the third deck into position and 
the corresponding coil on the relay. The positions 
on the fourth deck are connected to the numerical 
display. If numeral 5 appears on the display, that 
means that the wiping arm is on position number 
five on all four decks. If the microswitch con- 
tacts were closed now they will activate relay 
number 5 and change the status of outlet number 5. 
The contacts of relay number 2 supply low voltage 
to the telephone attachment jack. The relay con- 
tacts in position number 1 are connected to the 
hospital call cord, and perform the same switching 
function as does the pushing of the bell button 
on the regular cord. 

It should be noted here that another mode of 
operation is possible in which the motor runs con- 
tinuously and the numbers keep changing on the nu- 
merical display. This eliminates the starting cir- 
cuit and allows for a faster response. 

Answering the telephone is done in the follow- 
ing way. When the telephone rings the patient will 
puff on the microswitch and start the sequence. 
When number 2 appears on the display he will puff 
again, this will cause the solenoid on the tele- 
phone cradle to lift the bar off the hook. Now 
the conversation can proceed through the loud- 
speaker. To terminate the call the patient will 
recycle once more, wait for number 2 and puff. 
This will disconnect the solenoid supply and the 
bar will drop on the switch hook as if the re- 
ceiver were replaced on the cradle. 

Clinical Trial 

The prototype instrument has recently been 
placed in trial operation at the Rehabilitation 
Institute of Chicago, the 76 bed physical rehabili- 
tation hospital of the Northwestern University 
McGaw Medical Center, Chicago. The Rehabilitation 
Institute is a HEW Regional Spinal Cord Injury 
Rehabilitation Center. 

The evaluative results^ of the first patient 
and staff experience with the actuator are sum- 
marized here. 

Subject 

A 20 year old female cervical 5 level quadri- 
plegic with 9 week duration paralysis following 
a diving accident utilized the actuator for 18 
days. The patient had no pinch or grasp capability 
but could lift both forearms. Lung vital capacity 
was 50% of normal. The actuator provided patient 
control of four appliances: nurse call light, bed- 
side lamp, television and tape player. None of 
these could be manually operated by the patient 
and nurse call was normally verbal. A circuit- 
use counter recorded each appliance actuation. 

Actuator Use 

Average 24-hour use of the actuator during the 
last week of clinical trial was as follows: call 
light, 2; television, 6; lamp, 4; tape player, 1. 
Hence, 13 activities per day came under the control 
of this patient. Eleven of these activities 
would have required 2 trips each by a nurse (one to 
turn on, one off), or a total of 22. 



*The evaluation protocol was developed by the Re- 
habilitation Services Evaluation Unit of the Re- 
habilitation Research and Training Center, 
Northwestern University. 



Patient Evaluation 

The patient had never used any other mechanical 
device for call or appliance actuation and hence 
could provide no comparative evaluation. However, 
she indicated that the device "is much better than 
having to call a nurse or having someone else do 
it". "It*s really great." She noted that the 
micro switch was easier to activate by moving her 
forearm than by blowing, because it was not always 
in the correct position for blowing. Further, she 
noted, "it is not so pleasant having it (switch 
sail) in front of my face". 

Staff Evaluation 

Three nurses and three nurses aids evaluated 
the device in use. Five of six (83%) staff pre- 
ferred the actuator to two other mechanical hand 
or head activated mechanical call lights. Four 
(67%) noted that the actuator was saving call visits 
to the patient, a rather demanding and active young- 
er patient. Thus, both staff and patient were aware 
of increased independence of the patient. Other 
nursing staff noted that the device, as currently 
constructed, was somewhat awkward to position and 
occasionally in the way. On several occasions the 
numeral display box was accidently displaced from 
its mounting. Down time for electro-mechanical 
reasons was minimal during the trial period. 

Evaluation Conclusion 

Further clinical trial in hospital and home are 
anticipated to determine utility and durability of 
this actuator system. The indications are that 
patient and staff can use this device to effectively 
increase functional independence of severely in- 
capacitated high level spinal cord patients. 

Specifications 

Power requirements - 115 volts, 60 cycles 15 amps 

(depending on the controlled load). 

Cordset - 15 amps, 3 wire, grounded. 

Transformer - isolation step-down 115 into 24 volts, 

60 volt-amperes. 

Power supply - 24 volts DC 40 volt-amperes. 

Motor - 1 rpm 24 volts AC 40 inch-ounce. 

Rotary switch - 4 deck continuous rotation, 18 

position make before break contacts. 

Latching relay - coil 24 volts AC, contacts 120 

VAC 60 Hz 10 amps DPDT (courtesy Guardian Electric 

Manufacturing Company) . 

Microswitch - normally open SPST, 2 grams actuating 
arm, 24 volts AC (courtesy Cherry Electrical Pro- 
ducts Corporation) . 

Numerical display - 24 volts AC, ^ inch numerals. 
Solenoid - 24 volts DC, pull type, continuous 
duty, 3/8 stroke, 10 ounce minimum lift. 

Further Develop^ment 

The future development of this system will 
provide more functions with minimum increase in 
complexity. The telephone attachment would permit 
dialing operator (0) by using a rotary solenoid on 
position number 3 right after the telephone switch 
solenoid on position number 2. Full manipulation 
of television controls is next. A page turning 
machine should be very adaptable for this system. 

Conclusions 

If the feasibility of the system is justified 
by proper evaluation of such factors as usefulness, 
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cost and demand it is likely that a commercial 
enterprise will make it available to hospitals and 
individuals, bringing some relief where it is very 



much needed. This system means more convenience and 
independence to patients and less time and effort 
expended by nursing personnel. 
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SENSORY AIDS FOR THE HANDICAPPED; 



A PLAN FOR EFFECTIVE ACTION 
by 

Charles W. Garrett 
National Academy oi Engineering 
Washington, D. C. 20418 



Introduction 

The National Academy of Engineering es- 
tablished the Committee on the Interplay of Engin- 
eering with Biology and Medicine in June, 1967, to 
delineate ways in which our national engineering 
capability can be synergistically linked with medi- 
cal science and the delivery of health care. In 1969 
the Subcommittee on Sensory Aids was formed to 
provide advisory services to correlate, stimulate, 
recommend and initiate the research, development, 
evaluation and deployment of sensory aids for the 
hearing and visually impaired. 

In pursuit of these objectives the Subcom- 
mittee has organized and sponsored conference 
and compiled selective research, development and 
organization needs to aid those with sensory defi- 
cits. Publications are available from the Academy 
which report the proceedings of workshops on the 
evaluation of mobility aids for the blind and on 
sensory training aids for the hearing impaired. 
The Subcommittee's assessment of "priority 
projects" aimed at the amelioration of vision and 
audition handicaps will also soon be available, and 
are the topics of the next two papers this morning. 

This paper addresses itself to the problem 
of focusing efforts at the national level and devising 
organizational forms which will link research and 
social services in order to stimulate the develop- 
ment and delivery of needed sensory aids to the 
blind and deaf. It is the result of three years of 
Subcommittee deliberations and summarizes the ex- 
periences we have had in working in the field, the 
frustrations we encounter in attempting to operate 
within a fractionated and unorganized system, and 
the proposal we offer to bring some order to the 
chaos. 

The views expressed here today are taken 
directly from a position paper of the same title re- 
cently authorized for distribution by the Academy. 

The Problem 

There are nearly half a million blind people 
in this country, and more than four times as many 
with seriously impaired vision. The profoundly 
deaf number some 850, 000 and an additional seven 
million people have seriously impaired hearing. If 
these people with sensory handicaps were brought 
together, the numbers of the blind and visually im- 
paired would equal the populations of Memphis and 
Philadelphia, respectively; the deaf would fill 
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Cleveland; and it would require Baltimore, Chicago 
and Los Angeles together to hold those with seri- 
ously impaired hearing. 

Yet despite this multitude who are without a 
primary source of information, sight or hearing, 
relatively little effective use has been made of mod- 
ern technology to provide sensory aids - -devices to 
augment or replace the deficient senses. 

Sensory augmentation for both the blind and 
the deaf has been less than adequate because re- 
search and development have tended to be device- 
oriented, poorly supported, and fragmented. Three 
factors have impeded progress in the application of 
sensory aids. First, the very complexity of visual 
and auditory impairments and their consequences 
makes it difficult to define the problems to be 
solved* Second, a wide disparity and lack of co- 
ordination exists among the persons and organiza- 
tions fhat provide funds, generate ideas, and have 
specialized knowledge, research facilities, and re- 
habilitation services. Third, the market demand 
for sensory aids is unpredictable in an already 
economically disadvantaged subpopulationj such a 
market is unlikely to encourage private venture 
capital for research, development, and evaluation. 

We are capable of doing much more to help 
these people live better lives. 

To meet the needs of the blind and the deaf, 
a well-directed effort is required that is funded ar-d 
managed on a long-term basis. We must use our 
advances in science and technology to provide the 
required basic research on information processing 
by humans and to develop useful devices and systems* 
A national program to do this could bring great 
benefits to the sensorially deprived everywhere* 
But the problems are diverse and complex, and 
progress will depend as much on creative manage- 
ment as on massive effort. 

One important initial requirement is to create 
an effective means of communication among re- 
searchers, organizations, and workers for the im- 
paired individuals, and the users, themselves. Only 
with this interaction can a satisfactory balance be- 
tween fundamental research and technological de- 
velopment be achieved. At present, development 
projects are often undertaken without basic knowl- 
edge of user needs and capabilities, sensory infor- 
mation processes, and the realities of deployment. 
Moreover, evaluation of the utility of specific sen- 
sory aids and the development of appropriate 
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training procedures are practically nonexistent. 

The scale of planning and organization that 
is needed for the overall effort calls for a substan- 
tial commitment of funds. Further, there are high 
costs of prototype production and field trials, and 
the potential for profitable sales is limited. Also, 
we may expect that when truly useful sensory aids 
become available, a large demand will be created; 
the organizational and funding resources that will 
then be necessary have yet to be estimated, planned 
for, and mobi*'.zed. 

A unified national program can be instru- 
mental in solving these problems. 

The Needs of the Blind 

Blindness limits the ability to read, to en- 
joy normal mobility, and to perform many every- 
day activities usually dependent on sight. It also 
precludes an enormously important means of es- 
thetic communication, and it brings considerable 
economic disadvantage. 

Sensory aids should, at the very least, 
equip blind people for reading text and for moving 
comfortably in unfamiliar surroundings. Such aids 
must extract complex information from the environ- 
ment and present it to the user through his sense of 
touch or hearing or by making use of his residual 
sight. More useful aids that would assume some of 
the functions of the visual nervous system (thus 
serving as a substitute for actual vision) would ob- 
viously be still more complex and difficult to ob- 
tain, but they should be a long-range goal. 

The work done so far has resulted in a 
relatively small and inadequate arsenal of sensory 
aids, largely due to the problems noted above-- 
lack of coordination of long-range objectives, and 
of funding. Talking books, braille, and sighted 
readers (although inadequate) still are used instead 
of portable reading aids or automatic text-reading 
systems which are technically feasible and poten- 
tially more flexible. In mobility, modern technol- 
ogy has had no significant impact; the dog guide 
and the long cane remain the most effective mobil- 
ity devices in use. 

The Needs of the Deaf 

Deafness, while not as conspicuous as 
blindness, is as serious. Not only does the in- 
ability to hear deny an important source of informa- 
tion, but in addition deafness may impair a human 
activity of great impoi*tance--speech--and impede 
the development of the most important component 
of thought--language. Educational retardation of 
from three to five years is commonplace in an in- 
telligent child who is born deaf or loses hearing be- 
fore acquiring language. Speech comes slowly 
(and sometimes not at all) as the deaf student 
struggles to produce sounds he cannot hear. Social 
awareness and maturity are also frequently delayed 
because of the child's inability to learn through 



listening. A deaf child has far more potential for 
a self-supporting adulthood if he can learn to use 
speech and language effectively, yet most deaf 
children presently do not reach an achievement 
level much above eighth grade. It is therefore not 
surprising that 80 per cent of deaf adults fird them- 
selves in unskilled, dead-end jobs. Thus deafness, 
like blindness, can impose severe economic penal- 
ties. 

The three interrelated problems of deafncss- 
those of speech, hearing, and language--require 
quite different approaches. A person who loses 
his hearing after learning to speak will usually re- 
tain his speech despite a tendency for the speech 
quality to deteriorate. On the other hand, those 
who are born deaf or those who become deaf very 
early will not independently learn to speak or per- 
ceive speech. These people require not only pros- 
thetic aids to facilitate communication with others, 
but they also need some means of acquiring the ab- 
stract concepts of symbol manipulation on which all 
language depends. A relatively mild hearing loss 
can be adequately overcome with common hearing 
aids that simply amplify the important acoustic 
energy of speech. Thus, persons with such partial 
loss may need only a relatively simple sensory aid 
and some training in using it. 

A variety of sensory aids for the deaf have 
been developed, and most of them have been di- 
rected to the problem of salvaging residual hearing 
They operate either by giving as much useful sound 
amplification as possible or by transforming por- 
tions of the acoustic signal for use by intact parts 
of the hearing system or by other sensory channels 
But even though the essential technology for such 
devices is well established, and the aids are In- 
geniously designed and earnestly applied, only 
limited utility has been achieved. For most of the 
devices, the design has been ad hoc, many of the 
user's perceptual requirements remain unknown, 
and training and evaluation techniques are rudi- 
mentary. 

A Plan for Action 

The problems of the deaf and the blind are 
not identical, but there are similarities. Both 
groups need help in dealing directly with their 
surroundings on a day-to-day bas is . Additionally, 
the prelingually deafened must learn the speech 
skills and language concepts necessary for normal 
development and social intercourse. 

Basic research on the role of the unimpaired 
senses in learning about and communicating with 
the environment is essential to an understanding of 
the kinds of aids that could be used by both the 
blind and the deaf. Sensory devices can be de- 
veloped to give blind adults access to the printed 
word and to give deaf adults access to the spoken 
word as well as the ability to monitor their own 
speech production. For both, other kinds of aids 
could improve their mobility and safety in an en- 
vironment the blind cannot see and the deaf cannot 
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hear. For the very young deaf child, there is the 
urgent need for devices that will early detect a 
hearing impairment and for research to discover 
how these children can acquire language. AndforaU 
concerned, education is crucial--for training the 
users of sensory aids and for preparing their 
teachers. 

Thus the needs of both the blind and the deaf 
have four important elements in common: 

1. Communication with the environment 

2. Engineering interfaces with physio- 
logical senses 

3. Education 

4. Synergistic organization and administra- 
tion of science, technology, and human 
engineering. 

The organizational and research strategies 
for such an effort will involve diverse and complex 
problems. Solutions cannot be expected from indi- 
vidual inventors or from service organizations de- 
voted to conventional welfare. Rather, what is re- 
quired is a comprehensive national program which 
embodies the following elements: 

1. Information . Collection of demographic 
data; assessment of sensory needs; 
dissemination of information about rele- 
vant research in medical, psychologi- 
cal, and technological areas to planners, 
investigators, educators, the sensori- 
ally impairied. and the general public. 

2. Research and Development. Identifica- 
tion of fundamental problems requiring 
basic research, and of sensory aids 
meriting immediate development. 
Stimulation of research and development 
in university, government, and private 
laboratories. Performance of research 
(especially where the complexity of the 
problem or scale of effort requires con- 
centrated resources) and following 
through from that research to practical 
development. 

3. Evaluation and Deployment. Assess- 
ment of prototype devices for technolo- 
gical, physiological, and psychological 
adequacy and for user acceptance. De- 
velopment of systematic methods for 
the evaluation of sensory aids. Estab- 
lishment of effective training and de- 
ployment procedures, particularly in 
educational settings. 

4. Funding . Identifying and securing finan- 
cial support for the operating program 
outlined above, for cooperative efforts 
between organization;:, and for the high 
cost of proceeding from evaluation in 
the laboratory to deployment and main- 
tenance in the field. Without such 
follow-through, even the best of sensory 



aids lies fallow and useless. 

Organizational Options 

Various kinds of organizational arrangements 
for carrying on the foregoing activities will need to 
be considered since each kind has merits and 
limitations. Although the more than I, 000 organi- 
zations currently providing service to the deaf or 
blind are useful, not one is adequate for the total 
program outlined above. New organizations are 
required, and it is important to determine how the 
existing ones will be utilized and interfaced. Al- 
though separate organizations will be needed to 
deal with problems of the visually impaired and 
with those of the auditorially impaired, the factors 
that affect the choice or organizational arrange- 
ment are much the same and may be considered to- 
gether. Some alternatives that could achieve the 
desired actions are: 

1. National Centers, created within the 
federal government to execute and to 
subcontract research* development, and 
deployment. Both intramural and extra- 
mural programs would be pursued. 
These mission-oriented federal centers 
would resemble agencies like the National 
Center for Health Statistics or the 
National Communicable Disease Center. 

2. National Laboratories , existing outside 
the federal government and probably as- 
sociated with universities. Even though 
established in cooperation with the gov- 
ernment and funded by it, these centers 
would operate independently. They 
would resemble such national laboratories 
as Argonne, Lincoln, or Oak Ridge. The 
recently established Rehabilitation En- 
gineering Centers represer\t a movement 
in this direction. 

3. National Foundations , independent of the 
government (at least initially) and neither 
-funded nor operated by the federal estab- 
lishment. They would be supported by 
foundations, universities (possibly by 
government contracts), and industry; 
however, they could be planned for even- 
tual phaseover to federal support. Small- 
scale models for such national founda- 
tions exist as research institutes at- 
tached to many universities; on a na- 
tional scale, examples are the Woods 
Hole Oceanographic Institution, Carne- 
gie Institution of Washington, and the 
Salk Institute. 

Other organizational arrangements, less am- 
bitious and less adequate than these national estab- 
lishments, might well serve as lead-in, relatively 
short-range approaches. Two such possibilities, 
not necessarily exclusive of each other or of the 
national organizations, are 
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1. Interagency Coordinating Group(s ), 
created within the Executive Branch of 
the Federal Government to guide in 
problem identification, to act as an in- 
formation clearinghouse, and to inte- 
grate activities and reduce overlap 
among the many agencies serving the 
sensory-handicapped population, and 

2, Seeding Centers ^ utilizing key individu- 
als who would be deployed as nuclei in 
university environments or elsewhere 
to initiate research, development, and 
sm ill-scale evaluation and deployment 
of sensory aids. The principal aim 
would be to stimulate new researchers 
and to encourage new pilot projects. 
These individuals would be identified 
and encouraged by an informal central 
directorate such as that which can be 
provided by the national academies. 

For each of these five ways of organizing a 
national effort, there are advantages and disadvan- 
tages. One must consider, for example, the ease 
with which the present establishment would allow 
its formation, its ability to have an impact (particu- 
larly on federal agencies), its efficiency and its 
flexibility. In our Academy position paper, we have 
discussed some of these pros and cons in more de- 
tail. 

The foregoing plans for action at the national 
level are only outlines. The set of possible organi- 
zational arrangements may need to be expanded, 
but even the five possibilities I have listed require 
elaboration and careful study before one could feel 
comfortable in recommending one over another. 
The conduct of such a study and the development of 
a rational design for an integrated national sensory 
aids program thus becomes an urgent and immedi- 
ate challenge. 

Recommendations 

It is our Subcommittee's contention that a 
national task force should be assembled to serve as 
a central focal point and to perform the prerequisite 
study and plan. The task force would have two pri- 
mary objectives: 



1. To manage two major analyses which 
would include an extensive study of 
needs of the sensorially handicapped, 
the characteristics of existing service 
agencies, and alternative strategies for 
interfacing new organizations to those 
agencies to bring about the needed 
changes with maximum effect. 

2. To examine and evaluate various organi- 
zational and funding arrangements in- 
cluding those suggested above, recom- 
mending courses of action with detailed 
plans for implementation. 

^These two ief forts would enable the task 
force to satisfy iis most important goal--the de- 
velopment of a realistic long-term plan to apply 
sensory aids in the amelioration of blindness and I 
deafness. In a two-year period of time at a cost 
of around $600, 000, we believe that a concerted 
effort on the part of the task force would result in 
the completion of a national program plan. Further, 
implementation of the plan could be well underway. 
In addition and in parallel with the development and 
initiation of a coordinated national program, the 
task force would have other functions, including ad- 
vising on research and development needs, serving 
as an information center, conducting topical con- 
ferences and workshops^ and stimulating the evalua- 
tion and deployment of currently available devices 
a-nd techniques that would have immediate payoffs 
to sensorially deprived people. 

For objectivity, such a task group should 
operate outside the federal establishment, but its 
work would be useless if its objectives were not 
accepted by the agencies involved. Its 'output will 
include a recommendation to the nation; those re- 
sponsible for participating in the ensuing program 
must be receptive to Its purpose. 

We in the Subcommittee on Sensory Aids are 
convinced that the goals presented in this Plan for 
Effective Action are both vital and achievable', It 
remains for all of us to debate the issues not much 
longer, for there are people in need who await our 
skills. 
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SENSORY AIDS FOR TtiE DEAF - KEY PROBLEM AREAS 



by 

Harry Levitt 
City University of New York Graduate School* 
33 West 42nd Street, New York, N.Y. (10036) 



Summary . The development of sensory aids for 
the deaf presents an important engineering 
challenge, but one in which technological 
advances are highly dependent on developments 
in other areas. Among the key problem areas, 
are determining how the speech and language 
development in a deaf child differs from that 
in a normal child, determining the extent to 
which residual perceptual capacities can be 
used for speech reception, developing new 
diagnostic techniques, and improving methods 
of evaluation of new and existing devices. 
Aside from long-term basic research projects 
there are a number of short-term projects, 
which will provide immediate benefits. These 
include the development and widespread de- 
ployment of inexpensive teleprinters for the 
deaf, the development of efficient screening 
procedures for early detection of hearing 
impairments, and specific improvement to 
comventional hearing aids. 

Introduction 



The development of sensory aids for the deaf 
has progressed at a relatively slow rate over the 
past two decades. Thus, for example, despite the 
spectacular technological advances over this peri- 
od, an auditory aid that is superior to the con- 
ventional hearing aid has yet to be developed. The 
last few years have seen a substantial increase in 
the research effort geared towards the development 
of sensory aids for the deaf (1-6), much of which 
is characterized by attempts to apply modem tech- 
nology to the problem at hand. Because of the di- 
verse inter-disciplinary nature of sensory aid 
development there is a danger that much effort will 
be concentrated in finding elegant engineering 
solutions to problems that in the long run may be 
of minor importance. The purpose of this paper is 
to try to provide a balanced overview of key prob- 
lem areas in the development of sensory aids for 
the deaf. 

Although most of the problem areas identified 
in this paper are notprimarily technological, 
there is an important engineering challenge in 
providing the means to investigate these problems. 
Also, the answers to the research problems listed 
belowwill, in turn, dictate the technology needed 
to produce the desired sensory aids. The last 
section of the paper points to a number of short- 
term projects using existing technology which will 
produce immediate benefits. 

Any attempt at delineating key problem areas 
in the development of sensory aids for the deaf 
must take into account the heterogenous nature of 
the hearing-impaired population and the separate 
needs of distinct sub-groups within this popu- 
lation. Two of the most important groups are adult 
sensorineurals (mostly presbycusics) and congeni- 



tally or prelingually hearing impaired children. 
The former group is by far the largest and the 
latter group by far the most severely affected. 
Within each group, there are also substantial 
differences in the degree of hearing impairment 
which have to be consitVared because their needs 
are quite different. The adult sensori-neurals 
typically require communciation aids which will 
compensate a gradually failing auditory system. 
In adtlition to a communciation aid, the prelin- 
gually hearing impaired child requires substantial 
training to develop a speech and language capa- 
bility. Because of the severity of the consequences 1 
of prelingual deafness, most (but not all) of the 
problem areas identified in this paper deal pri- 
marily with the development of sensory aids for 
the hearing-impaired child. 

Although there are some technically advanced 
aids for use by individuals with conductive hear- 
ing impairments, these aids are not considered in 
detail because of the relatively small number of 
people who suffer debilitating conductive hearing 
impairments. Most conductive hearing impairments 
can be successfully treated by surgery or by con- 
ventional bone conduction hearing aids. 

In drawing up this list of key problem areas 
the author has drawn heavily on the deliberations 
of the subcommittee on sensory aids of the National 
Academy of Engineering which is currently in the 
process of preparing a document on priority re- 
search needs in this area (8). Other important 
sources of information are the Proceedings of the 
Conference on Sensory Training Aids for the Hear- 
ing Impaired (3) and CHABA Report 65 (9). The opin- 
ions expressed in this paper are, of course, the 
responsibility of the author. 



* Also at the Lexington School for the Deaf. 
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Key Problem Areas 

Fundaroental Research on Speech and Language 
Acquisition In Deaf Children 

Where a5« only a modest amount is known about 
speech and language development of normal child- 
ren, even less is known about speech and language ' 
develapment of deaf children. Neverless^ crucial 
decisions on the education of deaf children are 
continually being made. A key assumption underlying 
many educational programs is that language acquisi- 
tion in deaf children follows the same essential 
pattern as for normals, except that the time scale 
is considerably extended. Recent developments in 
psycholinguistics provide useful guidelines with 
which language development in deaf children may be 
measured. In order to better plan the education o£ 
deaf children it is important to establish whether 
language acquisition in the deaf follows the same 
hierarchy of development (albeit on an expanded 
scale) as in normal children, or whether basically 
new language forms are being developed. 

The orientation of f'.is research effort should 
be concerned not only with the process of speech 
and language acquisition and how it is affected by 
hearing impairment, but in determining what the 
remedial needs are and what can realistically be 
achieved. The phrase speech and language is used 
throughout since it is believed that the two are 
intimately interwined and that both oral and writ- 
ten forms of language should be investigated. 

Quantification of Residual Perceptual Capacity 

The intellectual development of the deaf child 
is crucially dependent on all of his perceptual 
abilities. This includes residual hearing capacity 
as well as perceptual capacity in other modalities. 
Methods for quantifying the information handling 
capacity of the visual and tactile modalities in 
the deaf child need to be investigated. Since the 
deaf child frequently also suffers from other sen- 
sory impairments, the possibility of concomitant 
sensory impairments needs also to be considered. 

The specification of hearing impairment in 
terms of the audiogram only is clearly inadequate 
and more appropriate methods of specifying resi- 
dual hearing are needed. Some research on the re- 
lation between residual hearing and speech per- 
ception is currently in progress (10) but much 
more needs to be done. 

The future development of sensory aids is 
heavily dependent on the extent to which residual 
hearing or other modalities can be used in the 
transfer of information. It is possible that the 
potential for inter-modality transfer may be cru- 
cially age dependent and this should be considered 
in investigating inter-modality transfer. 

The search for practical substitutes for speech 
should be pursued. The failures encoilntered in 
the search for acoustic, non-linguistic substitutes 
(11) should serve as a guide in avoiding non-pro- 
ductive avenues of investigation. A promising 
approach that merits immediate consideration is 
that in which key articulatory information (e.g. 
place, manner, voicing cues and/or prosodic fea- 
tures of human speecluare presented visually or 
tactually as an aid to speechreading. The problems 



of automatically extracting such information from 
the acoustic speech signal are not trivial and 
need to be studied. 

Improvement of Diagnostic Techniques 

Closely linked to the problem of quantifying 
residual hearing capacity is that of accurate di- 
agnosis of hearing disorders. This is a constantly 
evolving process, but at this point in time special 
emphasis is necessairy in developing reliable audio- 
metric procedures for very. young children and in 
developing tests of communication ability which 
realistically predict the hearing impaired indi- 
viduals performance in real-life situations (e.g. 
speech perception under noisy or reverberant con- 
ditions and capacity for handling and interpreting 
distorted speech signals). Methods for establishing 
measures of speech reception at the feature, sylla- 
ble, sentence and paragraph level have been sug- 
gested by Miller (ref.3 page 78) and these tech- 
niques should be investigated. 

Objective Evaluation 

A major obstacle in the development of sensory aids 
for the deaf has been the paucity of objective e- 
valuative data on new or existing devices. Without 
a body of objective data on which to build it is 
virtually impossible to make progress in any sys- 
tematic or reliable way. The problem of evaluation 
however runs deeper than detemining what a device 
can or cannot do. It is important to consider 
such larger issues as the potential impact of the 
device on the child's overall development and 
whether special training with the device represents 
a worthwhile investment of the child's time. 

In order to greatly increase evaluative effort 
it is necessary to develop objective evaluation 
techniques that are both efficient and practical. 
One of the advantages of f\ computer-based training 
system for example, is that the childs progress 
with a new device may be measured objectively, un- 
obtrusively, and with little additional effort dur- 
ing regular training sessions. Specific problems 
to be considered in the development of evaluation 
proreriiires are rate of progress, transfer of skills » 
atter specialized training. Efficiency of evalua- 
tionis of considerable importance and the use of 
sequential or adaptive testing procedures should be 
considered as a means for teminating experiments 
as soon as a significant improvement (or lack of 
improvement) is established. 

Speech Training Aids 

Of the various types of sensory aid that have 
been developed in the past few years, speech train- 
ing aids appear to have the greatest potential for 
success (12). The aids that have been developed 
and evaluated thus far cover only a limited range 
of speech problems. They are also used primarily 
for remedial work rather than aiding speech devel- 
opment. New aids need to be developed that will 
cover a wider range of speech problems as well as 
aids for very young children to aid speech develop- 
ment. Consideration should also be given to the 
development of semi-automated or computer-controlled 
speech-training aids that can be used for self- 
tutoring or for simultaneous, concentrated training 
of several children by one teacher. 
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Conventional Hearing Aids 

Considerable research is still needed on find- 
ing the optimum electro-acoustic characteristics 
of hearing aids and on ways for "fitting^* deaf and 
hard-of-hearing persons with aids that best satis- 
fy their Individual requirements. To do this, 
hearing impairments have first to be classified 
according to their origin andphsysiological nature, 
as well as according to the social, educational and 
communicative stiuations in which they offer the 
most serious handicap. The hearing aid require- 
ment of each of these groups will have to be de- 
termined experimentally and clinical procedures 
for fitting individuals with the most suitable aid 
investigated. This must include investigation of 
the ear mold as well as the electronic device 
itself. A detailed review of work in this area is 
that of Ling (13). 

A number of design improvements which could be 
introduced immediately are smoother frequency re- 
sponse curves, reduced non-linear distortion 
(especially when battery power begins to drop) , 
and the development of practical directional micro- 
phones. Special consideration should be given to 
the problems of hearing aids for babies and young 
children. These include physical robustness, small 
size, improved earmold design for small and grow- 
ing ears, and some means of monitoring externally 
(e.g. by the teacher) whether or not the aid is 
working properly. 

Optimum specifications need to be developed 
not only for wearable hearing aids, but also for 
group hearing aids (wireless or loop). The latter 
would include consideration of factors such as 
frequency response, permissable distortion levels, 
and the relative levels of the teacher's voice, 
the child's own voice, and other childrens* voices. 

For more detailed information on research needs 
for hearing aids see reference (9),. 

Adminis trative-Organi zational Needs 

In addition to the above problem areas all of 
which require substantial, long-term research 
efforts, there are a number of projects using 
existing technology which would have immediate and 
invaluable benefits at a moderate cost. There are 

(i) establish a nationwide program for screening 
all babies before the age of 1 year for evidence 
of hearing impairment or other sensory defects, 

(ii) get hearing aids fitted to ail infants immedi- 
ately they are diagnosed as hearing impaired, 

(iii) provide teleprinters at nominal cost to all 
hearing impaired who need on and (iv) Provide re- 
hnb~ litation facilities for adults with progres- 



sive and sudden hearing impairment where orient- 
ation to protheses and social/vocational situa- 
tions may be obtained. 

References 

1. J.M. Pickett, Ed,, "Proc. conf, on speech 
analyzing aids for the deaf," Amer. Ann. Deaf , 
vol 113, pp 116-330, 1968. 

2. Special Issue on Communication Aids for the 
Handicapped, IEEE Trans. Audio Electroacousties 
AU-17 , 265-303, 1969. 

3. H. Levitt and P. Nye, Ed., Sensory Training 
Aids for the Hearing Impaired, Conf^ Proc. » Nat. 
Acad. Eng., Washington, D.C. , 1972. 

4. G. Fant, Ed., Proc. Int. Symposium on Speech 
Comrounication and Profound Deafness , Stockholm, 
1970, A.G. Bell Association for the deaf, in press, 

5. Special Section on Speech Analyzing Aids for 
the Deaf, IEEE Trans, Audio Electroacousties, AU- 
2£, 2-41, 1972. 

6. Session on Aids for the deaf, 1972 International 
conference on Speech Communication and Processing, 
Conference Record, 230-274, IEEE, New York, 1972. 

7. Session on Aids for Handicapped, 1972 ACM Annual 
Conference, Boston, 1972 « to appear. 

8. Selected Research, Development and Organization- 
al Needs to Aid the Hearing Impaired. Recommend- 
ations of the Subcommittee on Sensory Aids of the 
Committee on the Interplay of Engineering with 
Biology and Medicine - to appear. 

9. Directions for Research to Improve Hearing Aidj 
and Services for the Hearing Impaired. Report of 
Working Group 65 of the National Academy of Sci- 
ences- National Research Council Committee on Hear- 
ing, Bioacoustics and Biomechanics, 1971. 

10. J.M. Pickett, "Speech science research and 
speech communication for the deaf in Speech for 
the Deaf Child . L.E. Connor, Ed., A.G. Bell 
Association for the Deaf, Washington, D.C, 1971. 

11. A.M. Liberman, F.S. Cooper, D.P. Shankweiler 
and M. Studdert-Kennedy , '"Why are spectrograms 
hard to read?" Am Ann. Deaf, 113, 12 7-133 (1968). 

12. H. Levitt, "Sensory aids for the deaf-an over- 
view" IEEE Trans Audio Electroacousties, to appear. 

13. D. Ling "Conventional hearing aids. An over- 
view" Volta Review, 73 (1971). 



40 



4 



SELECTED RESEARCH. DEVELOPMENT AND ORGANIZATIONAL NEEDS TO AID THE VISUALLY IMPAIRED 

by 

Patrick W. Nye 
Raskins Laboratories 
New Haven, Conn. 06510 

Sunnnary. The. National Academy of Engineering, through its Com- 
mittee on the Interplay of Engineering with Biology and Medicine 
and Sub-Committee en Sensory Aids, is about to publish a list of 
projects which it is believed could significantly accelerate the 
progress being made toward the development of new devices and ser- 
vices for the visually impaired. The Academy of Engineering has 
earlier argued the need for a coordinated program of sensory aid 
development and the list of projects names some of the more im- 
portant components o£ such a coordinated program. The items are 
divided into two categories — short term projects which can be 
attacked immediately with the expectation of early results and 
those which should be initiated now with long term objectives. 

The present paper points to some major features of the NAE 
proposals and indicates the reasons why we need a coordinated ef- 
fort toward the development of sensory prostheses for the visually 
impaired. 



Introduction 

The title of my paper has been borrowed from 
the title page of a working paper which is about to 
be published by the National Academy of Engineering 
(NAE) . Anyone wishing to obtain a copy may easily - 
do so by applying to the NAE. My paper will de- 
scribe something about the background to this docu- 
ment, indicated a little of what it contains and 
intersperse a few comments. 

I think that most people here will be well 
aware already that the idea of using current tech- 
nological accomplishments to aid the blind in read- 
ing and mobility is not new. The recently develop- 
ed devices wh^.ch have captured the interest of many 
people are not the only aids to have been invented .In 
fact the history of such invention dates back to the 
beginning of this century and perhaps even earlier. 
What makes many sensory devices interesting today 
is not their novelty so much as that current tech- 
nology has made much more practical the possibility 
of constructing them compactly and inexpensively. 
However, we must ask whether technical limitations 
have been the only bar to progress in the design and 
manufacture of useful sensory devices? Can we ex- 
pect that, with this single development (better . 
technology) , we can now begin to make real progress 
toward providing genuine assistance to the visually 
disabled? Many people (and I must admit to being 
one of them) believe that the answer to both of 
these questions is no. It is not merely technology 
which has held us back. Why then despite seventy 
years or so of effort do we still, for example, not 
have a single mobility device for our blind popula- 
tion that can hold a candle to the dog-guide or the 
long-cane? The reasons derive from a number of pro- 
blems most of which are not unique to the sensory 
aids field but when present in combination as we 
find them here, they form a very serious barrier 
which must be recognized and removed if real pro- 
gress is to be made. 

Conflicts in the Development and 
Distribution of Sensory Aids , 

The problems for the most part are not diffi- 
cult to see. They were reviewed in a report pub- 



lished by the National Academy of Sciences (NAS) in 
1968 (1). Let me touch on some of these problems 
now. First and foremost is the enormous scope of 
the assignment— the development of a device which 
must serve as a substitute for the visual system in 
cerebro-motor tasks of great complexity. Too often 
this complexity is overlooked or underestimated and 
many devices (some of which are conceived over and 
over again) made demands on the skills of the user 
which go well beyond his ability to respond. Thus 
he is unable to operate the device at the speeds 
which are required in practical situations. For ex- 
ample he may be able to read by ear or touch using 
a simple acoustic or tactile transducer but so slow- 
ly that boredom rapidly sets in and the device is 
soon rejected except for very limited tasks. 

Sometimes the quest for a simple device is 
dictated not necessarily by the designer's lack of 
imagination, so much as by his knowledge that the 
blind population cannot bear the cost of a more com- 
plex device and by his assumption that society as a 
whole will not be prepared to bear the cost either. 
With this fact In mind, it is indeed surprising that 
the blind population of the United States (more than 
half of which has an average Income of less than 
$4000 per year (2)) can still be thought of as if it 
constituted a market in the commercial sense — yet 
many would-be designers of sensory aids and devices 
do still think in these terms and the spirit of in- 
dividual entrepreneurial enterprise is still very 
much alive. The paradox here la even more striking 
when it is realized that the overwhelming bulk of all 
development work being carried out today is being 
supported by public funds. However, the reason for 
this contradiction probably lies in the fact that 
much of the work is being supported as if the blind 
population was expected to eventually provide full 
market support through the purchase of devices, once 
their basic research and development has been com- 
pleted. Thus the emphasis of current research is 
still focussed primarily on simple low cost devices — 
devices which can demonstrate early successes but 
probably having very little potential for the im- 
provement needed for ultimate practical use by a 
significant number of blind people. The funds wade 
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available for research and development are conse- 
quently small and, in their turn, severely circum- 
scribe the vision used in seeking new ways of pro- 
viding potentially useful sensory devices. Limited 
funds from numerous agencies also lead to the set- 
ting up of small fragmented projects which are unco- 
ordinated with one another; duplication of effort 
thus inevitably occurs in addition to the repetition 
of Old mistakes and ideas. Moreover, in the event 
that sensory aids of some merit are developed, their 
deployment is severely handicapped due to a total 
lack of the kind of forward planning required to 
provide essential capital to set up manufacturing, 
distribution and training facilities. The prevail- 
ing assumption appears to be that these aids should 
be able to attract venture capital on a return on 
investment basis. However, as has already been 
pointed out, the blind population is economically 
weak and cannot compete with the many other markets 
open to an investor. Thus even useful devides tend 
to be ignored and the population they could serve 
continues to be neglected. 

I have just given a brief summary of the situa- 
tion described in the NAS report (1) which points 
to the conflicts which pervade and hinder efforts 
to develop sensory aids. The report makes clear 
that we even have no very clear definition of what 
the major needs are among the blind and what our 
priorities should be. Furthermore at the time the 
NAS report was released (1968) no serious study had 
been undertaken or was planned which could lead to 
such a definition of what our goals should be and 
the social and economic importance to our society 
of attaining those goals. However, in 1971 the 
National Academy of Engineering put forward *A 
Plan for Effective Action' within which the steps 
of research, development, evaluation and deployment 
could be coordinated in an orderly and expeditious 
way (3). The details of this plan will be described 
by Mr. Garrett in his paper presented at this con- 
ference, so I will not say anymore about it now. 

Projects to Aid the Visually Impaired 

One of the major themes of the NAS report was 
that there were opportunities available for the 
development of sensory aids which were essentially 
untapped. In an effort to point out some of these 
missed opportunities the National Academy of Engi- 
neering's Sub-Committee on Sensory Aids recently 
published a working paper with the title I have 
taken (borrowed) for this paper. The document con- 
tains a list of projects — not an exhaustive list 
but a selected list of Research, Development and 
Organizational needs. Many of the projects are un- 
explored, but not all. By the standards set by cur- 
rent efforts some may be judged ambitious (which Is 
not to suggest that this is a fault) but again not 
all have this trait. Together the suggested pro- 
jects are seen as comprising many of the opportu- 
nities which should be explored in any program 
claiming to be comprehensive — the kind of program 
which must be mounted if we arc to be able to say 
that we are making a serious effort to develop 
effective sensory aids without unnecessary delay. 

The NAE pgpcr is divided into two parts: short 
term projects which can be attacked immediately with 
the expectation of early results and those with 
longer term objectives which, in the opinion of its 
authors, should nevertheless be initiated now. I 
will briefly run down its list of contents and then 
describe a few selected projects In more detail. 



The short-term list includes a demographic sur- 
vey of reading aid needs; provisions for the ex- 
change of information between investigators; pilot 
studies of the potential usefulness of automated 
reading services; work on the development of those 
services; the development of new mobility aids and 
new tactile stimulators; further research and de- 
velopment in the field of automated braille produc- 
tion; the formulation of better definitions of 
visual capability among the partially sighted and 
the development of special devices to aid both the 
blind and the partially sighted to perform certain 
vocational tasks. 

The long-term list calls for demographic sur- 
veys of vocational opportunities; programs to in- 
form the general public of the benefits which could 
be reaped from research designed to enhance the 
participation of the visually disabled in our 
society; the establishment of one or more sensory 
aid centers; the performance of some essential basic 
research on human mobility, visual pattern process- 
ing and reading and finally a feasibility study of 
automated reading services provided via the tele- 
phone. 

I do not have the time to go into all the de- 
tails which the paper provides on each of these 
topics. I will therefore only touch upon a few by 
way of an illustration. 

First the proposal for a demographic survey of 
reading aid needs, points out that past efforts to- 
ward making reading matter available to the blind 
have been made in the absence of any reliable infor- 
mation on the reading needs of the blind public. 
The survey advocated in the paper would consider 
such variables as the type of reader (student^ 
housewife, businessman, etc.), biographical data 
(degrees of handicap, education, etc.), the type of 
material required (type styles and size used, its 
variability and format, etc.) and the preferred out- 
put sensory medium (tactile, or auditory modality or 
a magnified visual image). The fact that this pro- 
posal appears as the first on the list is of course 
no accident. An accurate description of the scope 
of the problem must be obtained as a logical first 
step. It may be of interest that a survey similar 
to the one proposed by the Academy's subcommittee 
was carried out in England about eight years ago 
and covered both the reading and mobility habits of 
the blind (4). 

Second the Academy paper states that radar, so- 
nar and lasers afford an important potential means 
of sensing the environment. However, their promise 
for the blind is still largely untapped although 
some initial efforts have been made. The report en- 
courages the development of a more innovative ap- 
proach to the use of these media by first establish- 
ing what information about this environment the 
blind traveller needs to know and then seeking the 
means of extracting this information utilizing the 
best sensors now available (5). 

Further research and development on automatic 
braille production is also advocated. The thrust 
of the proposals is directed toward the development 
of optical readers suitable for the kind of reading 
matter which must be transcribed into braille, the 
acquisition of teletypesetter's magnetic or punched 
tapes from publishers, the development of a centra- 
lized library of such tapes and the design and de- 
velopment of the necessary automated production 
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equipment. As many of you will already be aware 
some motion toward automating braille production 
has been underway for several years. The major dif- 
ference of approach proposed by the Academy commit- 
tee is t}iat a direct effort should be made to de- 
velop the necessary equipment in those areas where 
in the past researchers have tended to wait for 
technical developments inspired by the business and 
commercial market and funded almost entirely from 
that source. Vhile keeping the costs of braille re- 
search low, this policy has caused slow progress 
owing largely to differences between the needs and 
priorities of the braille and business communities. 

Yet another proposal concerns a study of the 
usefulness of automated reading services for the 
blind. These services could provide blind subscrib- 
ers with tape recordings of computer generated 
speech from any designated printed text. Working 
in a similar way to the talking book service of the 
Library of Congress or Recording for the Blind, an 
automated service could provide a recording of a new 
book much more rapidly than is currently possible 
using human readers (in a matter of hours or days 
rather than in months). Now again, work has already 
begun on this project at Haskins Laboratories and 
elsewhere and Jane Ga itenby and her colleagues will 
discuss some details of this project at another ses- 
sion of this conference. However, despite the fact 
that enough progress has been made for, we at 
Hasklns to say that we know that we could build a 
machine to provide a reading service, we are pain- 
fully aware that there is a large gulf between show- 
ing that a machine can be made to work in the labo- 
ratory and getting it into service outside, A small 
academic organization, like our own for example, 
simply does not have the resources in manpower and 
space (not to mention funds) to carry out the sur- 
veys and demonstration projects which might propel 
such a service into operation. The Academy pro- 
posal points to some of these important complement- 
ary programs which other organizations may be able 
to contribute in our own and other similar situa- 
tions. 

The last item I will mention concerns aids for 
the partially sighted who comprise about 80^ of the 
so-called legally blind population (6). The sug- 
gestions put forward include a proposal for the 
better dissemination of information about existing 
optical aids, the setting up of standards for the 
closed circuit television systems which are only now 



becoming available for the partially sigliced and the 
use of modular construction techniques to facilitate 
Interconnection and thus maximize the aid as a 
teaching device for children. 

Concluding Remarks 

In conclusion, the working paper as its fore- 
word tells us, is intended to stimulate new ideas 
and to encourage new people to work in the field of 
sensory aids. Many interesting and highly worth- 
while projects are proposed for their consideration. 
However, the topics discussed are only suggestive 
and not exhaustive. The reader is urged to delve 
into the literature of published reports if he is to 
really come to grips with the details of each pro- 
blem area. 
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Abstract * An electromagnetic device was used to drive 
the ossicular chain of kangaroo rat and man. Electri- 
cal potentials recorded from the cochlea of kangaroo 
rat to such a drive were the same as when acoustic 
stimuli were used. The same device, when used to 
drive the human ossicular chain, initiated sound 
sensations which were undistinguishable from those 
generated by earphones. 



Introduction 

This research was undertaken in order 
to develop and evaluate an electromagnetic 
device to drive the ossicular chain better 
than the currently used hearing aids. 

In 1959, Rutschmann (1) reported that 
electromagnetic stimulation of the eardrum 
provided auditory experiences. . .in a band 
of frequencies from 2,000 to 10,000 cps" 
and that subjects "have listened to broad- 
casting programs and claim that the repro- 
duction was satisfactory." The subjects 
in these studies were patients who had 
undergone either electroconvulsive therapy 
or psychosurgery. Although the findings 
were encouraging, no further reports were 
forthcoming. 

Several years later, a study on the 
response properties of primary auditory 
neurons in cat was conducted using an 
electromagnetic drive of the eardrum (2). 
The objective of this research was to show 
(and it did) that either "attraction or 
repulsion" of the eardrum was sufficient 
to drive auditory neurons. This study used 
powdered permanent magnets that had been 
pasted on magnetic tape. Small pieces of 
the magnetic sheet were pasted on the ear- 
drum and a powerful magnet was used to 
polarize the eardrum causing an attraction 
or a repulsion, depending on the polarity 
of the pulse. This study did not provide 
details about the cochlear microphonic 
responses for such stimulation. 



instrument. One end of each ear bar was 
inserted carefully into the ear canal and 
an earphone was attached onto the other 
end. Acoustic stimuli of various intensive 
and frequency combinations were used. The 
cochlear potentials to these stimuli were 
recorded on magnetic tape for subsequent 
comparison to electromagnetic stimulation. 

Following these recordings , one ear 
was freed from the ear bar and a^small 
magnet, measuring less than 1 mm^ (9*0 mg) 
was glued to the umbo of the eardrum with 
an adhesive. A coil was positioned within 
1-2 mm of the magnet. The coil (Fig. 1) 
had a resistance of about 2.0 ohms and 



The present study was undertaken in 
order to measure and compare the cochlear 
microphonic potentials generated by 
acoustic and electromagnetic stimulation 
and to use electromagnetic stimulation to 
transmit sound to the human ear. 

Methods 




Five kangaroo rats (D. spectabilis ) 
were used in the studies in which the coch- 
lear responses were obtained. They were 
anesthetized with sodium pentobarbital, 
following which a nichrome wire was placed 
near the round window of each cochlea. The 
animal was placed in a stereotaxic instru- 
ment and sounds were delivered through 
hollow ear bars which were attached to the 
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5. 1. Coil and magnet used to drive 
ossicular chain. Vertical 
calibration marks are in 
millimeters . 
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Fig. 2. Cochlear potentials to acoustic 
and electromagnetic stimulation. 
Each response is the average of 
25 stimulus presentations. Clicks 
were generated by a 0.10-msec 
square pulse through earphones and 
coil. Acoustic tones {20-msec 
duration; 5-msec rise-fall) were 
delivered across earphones. 
Sinusoids into coil were also 20 
msec, with 5-msec rise-fall time. 
Attenuations for acoustic tones 
are below a reference level of 125 
dB (SPL) for a 1.0-kHz^sinusoid 
measured from a 6,0-cm^ coupler ♦ 
(A) Click, -65 dB acoustic and -30 
dB electromagnetic* (.B) 0.5 kHz, 
-85 dB acoustic and -55 dB 
electromagnetic. (C) 1.0 kHz, 
-85 dB acoustic and -50 dB 
electromagnetic. (D) 2.0 kHz, 
-85 dB acoustic and -50 dB 
electromagnetic. (E) 3.0 kHz, 
-85 dB acoustic and -50 dB 
electromagnetic. (P) 4.0 kHz, 
-85 dB^ acoustic and -50 dB 
electromagnetic. (G) 1.0 kHz, 
-30 dB through coil without 
magnet on umbo. Vertical cali- 
brations represent 100 jxV and 
horizontal calibrations 6.0 msec. 
Note that the action potential 
response appears most distinctly 
in B for the acoustic and 
electromagnetic drive. 



^ a^l^ ■ 



inductance of 33 \xK. It was driven to a 
maximum level of 0.1 W by a 1-W amplifier 
and was coupled to the amplifier through a 
transformer network to provide appropriate 
impedance matching. Various combinations 
of frequency and intensity were used to 
drive the electromagnet ically coupled 



device. The cochlear poteritials to this 
stimulation were recorded on magnetic tape. 

In. the study with a human subject, 
the magnet was placed on the umbo of the 
eardrum with a thin layer of Aquaphor. The 
subject lay on r. table in an acoustically 
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shielded booth. The coil v;as . positioned 
near the magnet and sounds — including 
speech--v;€re delivered to the coil. 

Results and Discussion 

Fjgure 2 summarizes the results of 
one of the kangaroo rat studies. The fig- 
ure shows the acoustically evoked cochlear 
potentials and the electromagnetically 
evoked potentials to a limited number of 
sound s« comparison of the potentials 
shows that they are strikingly comparable* 

The acoustic and electromagnetic 
stimulators were used to drive the ears 
over an intensive series for frequencies 
between 0.5 and k.O kHz. Trace G in Fig* 2 



shows the averaged trace which was obtained 
before the magnet was placed on the umbo. 
An intense 1.0 kHz signal was delivered 
through the coil. It is clear the coil 
does not generate a response in the absence 
of the magnet. 

The microphonic potentials generated 
by both the acoustic and electromagnetic 
stimulator varied identically as intensity 
was increased or decreased, at all of the 
frequencies we presented (Fig. 3). 

In order to firmly establish that the 
microphonic responses to electromagnetic 
stimulation are real, we administered a 
lethal dose of sodium pentobarbital to the 
animal and measured the microphonic ampli- 
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Fig-. 3. Intensive furictions of microphonic 
potential to acoustic and 
electromagnetic stimulation. 
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Time after Lethal Dose, minutes 

Fig. 4. Decay of microphonic potential 
following lethal dose of sodium 
pentobarbital. All data points 
are response amplitudes of 
microphonic potential to a fixed- 
intensity 1.0 kHz signal. 



tudes at various times after the adminis- 
tration of the drug. Figure h shows the 
decay of the response over a 150 minute 
period. 

The results on the human subject are 
preliminary but, nonetheless, striking. 
Through electromagnetic coupling, he heard 
sounds, some of which were whispers, with a 
clarity equal to sounds generated by 
earphones . 

Acoustic amplification devices have 
peculiar disadvantages. Body aids amplify 
sounds produced by clothing and assist 
minimally in sound localization. Ear-level 
aids have gain limitations because of 
acoustic feedback. 

The present study shows that the 
ossicular chain may be driven by a non- 



acoustic source. By this means, it is 
possible to eliminate the problem of 
feedback and still preserve the advantage 
of an ear-level aid. 
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MECHANICAL SPEECH RECOCTaTION FOR THE PARALYZED OR PROFOUNDLY DEAF 



by 
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Summary * Automatic speech recognition could serve the deaf 
by transcribing speech that cannot be heard to text that 
can be read. Or it could serve the paralyzed by providing 
speech control of mechanical devices. Past, present, and 
future trends in automatic speech recognition arc discussed 
to shed light on the technical and economical prospects of 
using this tool to assist the hcindicapped. 



Introduction 

Xerox is engaged in a pilot research program 
investigating automatic speech recognition. At 
present, our efforts are not specifically intended 
to result in mechanical adjuncts for the 
handicapped. Nonetheless , we hope to contribute 
to a technology which, in a fundamental sense, 
would provide an alternate communication channel 
between a roan and his environment, a channel 
requiring neither hands, nor fingerS/ nor ears. 
Automatic speech recognition will someday allow 
any man to cast his thoughts in writing several 
tiroes faster than he could possibly type. Such 
written text might then control machines or be 
sent to a human audience. But this eventuality is 
several decades away and more immediate uses of 
automatic speech recognition (ASR) can be 
proposed, particularly for the handicapped. The 
possibility of economical voice control of 
mechanical devices will be explored in parallel 
with aids for the profoundly deaf. 

The profoundly deaf may be able to learn to 
read "noisy" phonemic transcriptions of utterances 
before a machine is developed to do so. This is 
because of the basic inadequacies of machines 
compared to man in utilizing contextual cues. The 
"artificial intelligence" required for general 
continuous speech ASR will be years in coming. 
Meanwhile, members of the ARPA speech coimnunity, 
Xerox, IBM, and other organizations are developing 
tecliniques for mecheuiical abstraction of phonemic 
features from speech, as part of larger ASR 
projects, which might already be suitable for 
reading. Examples of phonemic utterance 
decomposition will be presented and an 
experimental reading program will be suggested 
after an examination of ASR for voice control of 
nechanical devices. 

A Short History of ASR 

Automatic speech recognition is eibout 20 
years old. In 1952, an isolated word recognition 
unit was built by Davis, Biddulph and Balashek at 
Bell Labs; they named it Audrey. It could 
recognize 10 digits in real time for a single 



speaker with 97% to 99% accuracy. The parts cost 
today for Audrey would probably be around $100.00. 
Since then over 100 independent researchers have 
built isolated word recognizers. Supporting 
institutions include such organizations as IBM, 
GE, RCA, Sylvania, Bell Telephone Laboratories, 
Bulova Electric, General Dynamics, The Royal 
Technicalogical Institute of Sweden, London 
University, Edinburgh University, M.I.T., 
Stanford, Bolt Beranek and Newman, Systems 
Development Corporation, Nippon Electric of Japan, 
Radio Research Laboratories of Japan, and Kyoto 
University of Japan, the Air Force Scientific 
Research Center at Rome, tlie Air Force Research 
Laboratory at Cambridge, the Maritime Electronic 
Laboratory in San Diego, etc. No commercially 
successful ASR device of any consequence has been 
developed in all these years. (However, this 
situation may be changing. A respectable product 
was brought out this year by Threshold Technology, 
Inc.) Even today, Audrey '.«>uld be a strong 
contender among voice control units for 
controlling lights or bed heights for paralyzed 
people. 

In 1958, at Bell Telephone Laboratories, 
Dudl.ey and Balashek^ built an utterance recognizer 
(which they didn't name) based on phonemic 
classifications. (The phonemic strings produced 
by this device looked much like the ones shown in 
TcUale 1, which were in fact produced this year by 
a new procedure at Xerox.) Like AiJdrey, it 
identified voiced continuants by a simple method 
primarily intended to measure the frequency of the 
first and second formants (resonances) in a 
speaker's voice. (In 1952, Peterson and 
Barney-^ demonstrated that most vowel sounds in 
General American English could be classified by 
simply measuring the first eind second formants.) 
For Audrey, this was done by simply splitting the 
audio spectrum into a high frequency band 
(everything cibove 1000 cps) and into a low 
frequency band (everything below 900 cps) . The 
frequency of the first formant, which lies in the 
low band, was found by counting zero crossings 
(the number of times the amplitude vs. time plot 
goes through zero). Tlie location of the second 
formant in the second band was also found by 
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TA^LE I. PHONEME STnWGS GENERATED FROM PRONUNCIATIONS OF TEN DIGITS, 



ZERO 



ONE 
ONE 



TWO 
TWO 



THREE 
THREE 



FOUR 
FOUR 



FIVE 
FIVE 



SIX 
SIX 



SEVEN 
SEVEN 



EIGHT 
EIGHT 



NINE 
NINE 



^ZZZ22Z2ZFFEEEIIIIIIIl3@09OOOUURKRRRRRRRRnRRRRRROOOOUUUUUWV 
2ZZZZZZZZFFlIIIIIIIIIIII?)@@UUUUURRRRRRR^3^@3i3<3000000UUUWV 

UUOOOOAAAMA33333333339i9NNWVV 
UUU000O;JVAAAAA3 3 3 3 3 3 3 3 33 3NNNNMN Wl.'V 

FFFFFFFFFIIIIIIIIIIIII^0@5EEEUUUUUUUUUU 
FFFFFFFFFI IIIIIIIIIII lEEEUUUUUUUUOOW 

FFFFFFFFFFRRRRRRRRRR33 331 1 1 II 1 1 1 1{3^^^)EEnEWVWVWV 
ZZZFFFFWFFRRRRRRR3 3 3 1 1 1 1 1 II I lEEI I WWWVWV 

FFFFF**0OOOOO00OOOO0OO0OO00RROORRRRRRR 
ZZZFFFFFFFFFFWAAOOOOOOOOOOOOOOOORRRRRRR 

VWVFFFFFFFAAAAAAAAAAAAAAA333AAAAA33330(3RRRRRR 
VWVFFFFFFAAAAAAAAAA333333AAAAA3333333333EEII<^9i?@UUWW 

SSSSSSSSSSSSSSSIIIIIIII3333WW**********SSSSSSSSSSSSSSSSSSS 
SSSSSSSSSSSSSSSIIIIIIIII33IIVWV**********SSSSSSSSSSSSSSSSSSS 

FFFFFFFFFFFFFFFFF33333333333UUNNMW333333VVNNNNNN 
FFFFFFFFFFFFFFFFFF333333AAAUUUUVW33333VVNNNNN 

IIIIIIIIIIIIIIIIIIIIEEEEFFWV********SSSSS5WW 
IIIIIIIIIIIIIIIIIIIIIIEEFFFW*********SSSSSSWW 

NNNNNN33333333AA33333333333333333333EEEEEEEENNNNNN 
NNNNN333333333333333333333333333333333IIEEEEEFFMNIJNNNNNNN 



counting zero crossings. The Dudley-Balashek 
device used an 10-channel, bandpass filter 
preprocessor which identified the two formants by 
the two channels with the most energy. Variations 
of these two foms of audio "preprocessing" (zero 
crossing and/or band pass filtering) have remained 
the favorites throughout the years ^ and the 
majority of successful systems that have worked in 
real time used one of them. 

An interesting, inexpensive exception is 
"shoebox"^, IBM's voice controlled adding 
machine, which was entered in the 1952 World's 
Fair. Simply measuring acoustic asymnetry enabled 
this device to run with better than 96% correct 
responses on its 15 word vocabulary. 

An important feature of all ASR devices 
developed to date is that they perform well only 
for the single speaker for which they are tuned. 
Error rates increase by nearly a factor of 5 for 
new speakers* As a rule of thumb, the better 
systems over the past decade have run about 99% 
for the special speeOter and about 94% on random 
speakers on a 10-word vocabulary. (Again, 
exceptions are beginning to emerge^.) Furthermore! 
nearly all the algorithms used successfully on 
small vocabularies {15 words or less) have failed 
miserably on large vocabularies (100 words or 
more) . There- were only tvro systems prior to 1970 
that did much better than 90% on large 
vocabularies (Bobrow and Klatt^ and Vicens and 
Reddy') and these required large scale computers. 
These large systems would be prohibitively 
expensive as aids for the handicapped* 

Present and Future 



Times are changing, since 1970, the 
following events have occurred. Ilark Medress^ at 



Univac successfully demonstrated algorithms that 
recognized 100 words with 94% accuracy with no 
special tuning for the individual speakers. 
Threshold Technology r Inc,^ built fin isolated word 
recognition \mit that gets 99.5% on 21 words with 
tuning for single speakers* (This unit is the 
only one commercially available in the U*S* and 
sells for about $15,000* It vould be my first 
choice as a voice control unit today*) The 
Advanced Research Projects Agency of the D*0,D, 
decided to support speech research (these goals 
include: continuous speech recognition for a 
1000-word vocabulary with near real time response) 
vjith about ten million dollars to be expended over 
a five-year period* (They are now one year into 
the project.) The Japanese government earmarked 
about half their total research budget for the 
next eight years (v;hich amounts to over 100 
million dollars) for the support of artificial 
intelligence research which includes ASR* Rumor 
has it that IBM is expanding their ASR effort in 
hopes of delivering a phonetic typewriter by 1980* 
Furthermore » IBM produced the first telephone ASR 
system enabling field engineers to dial up the ASR 
computer system in Raleigh, N.C* and to speak with 
a 13-word vocabulary of 10 digits , "yes" , and "no" 
and a delimeter* No speaker adaptation is 
required* History was made this year in Reddy's 
laboratory at Carnegie-Mellon University with the 
first successful demonstration of continuous 
speech recognition* All this activity leads me to 
believe that this decade is destined to see some 
dramatic advatices in ASR* 

V7hat will this do for the handicapped? For 
one thing, it seems likely that a single speaker 
50 word, isolated utterance recognizer, running in 
real time at 99% accuracy, and costing less than 
$2000 will become a reality. I would hope that 
such a device would benefit the paralyzed by 
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giving them speech control of mechanical assists* 

The deaf may benefit in an unexpected and 
perhaps more draradtlc way. ASR reseeurch may very 
well produce both a training aid and a 
communication tool. A visible phonemic 
decomposition of words uttered by a deaf speaker 

could enable him to see what sounds he has 
produced. Alternately he could see what his 
conver.sation mate has said. 

Phonemic strings produced by algorithmic 
analysis of acoustic waveforms have never been 
very good. How good would they have to be for 
these applications? Recent experiments in 
perception provide an interesting answer. 

heading y Hearing and Perceiving 

Keeping in mind that there are no natural 
word boundaries in continuous speech, consider che 
following jihrase (from Broad^) which we may assume 
has been phonetically (or phonemic ally) encoded 
with no word boundary markers and given to a 
computer to analyze. 

"THERE IS A JUSTIFIED PRIDE IN" 
or is it "THEIRS A JUST IF I'D PRYED INK". 
Is it TFH:RE or THEIR; PRIDE, PRYED, or PRIED; 
IN or IN?I; PRY DIN or PRIED IN, and so forth. 

Problems of this sort don't occur for human 
users of English because they possess knowledge 
about likely meaning of language fragments 
(semantic knowledge) as well as a multitude of 
subconscious syntactic and phonological rules 
about phonemic sequences. A machine with no 
semantic or syntactic knov;ledqe faces an 
impossible task when asked to reconstruct 
unambiguously the sentence above from its phonetic 
or phonemic encoding. (It is precisely this 
problem that stands athv7art the path of progress 
of ASR for continuous speech.) 

Evidence indicates that motivated people 
could read phonemic transcriptions of utterances 
very successfully in near real time for normal 
conversation. 

First of all, we need to hear only relatively 
small fragments of speech to follow a 
conversation. Dennis Klatt at M. I.T, tells of an 
experiment wherein some tape recorded continuous 
speech was cut and spliced to produce isolated 
utterances from the once continuous speech, ne 
found that only half the words could be recognized 
in isolation! Richard Warren and Roslyn 
Warren^O found that a cough could be artificially 
recorded over an entire syllable of a word (e.g. 
the "gis" in "legislature") with no change in 
perception of the word. Listeners reported 
hearing a cough somewhere in the word, but \^rere 
unable to tell in which part of the word the cough 
occurred. Furthermore, reading experimentsU by 
Kolers indicates that people do not read many 
individual letters in words. In fact, if one were 
required to read letter by letter, his top speed 
would apparently be about 35 words per minute. 
Readers rely heavily on gross word morphology and 
(here we are againJ) semantic and grammatical 
knowledge: Pe*ple c*N re**d w*ll w**h *h*le 
s*gin*nts *f w*rds miss*ng. 

In svumnary, we neither hear nor see all that 
we think we do in natural lauiguage communication. 



Our mental eyes and ears are continually filling 
in gaps in words for segments that either don't 
exist or that are not really necessary to the 
message. So we could probably read poor plioncmic 
strings. Just how poor remains to be resolved by 
experimentation. 

For example, a good experiment might 
incorporate a real time phonemic transcription 
aparatus, a programmed language course and viewing 
glasses providing a split field of vision. One of 
the students eyes should be continuously 
monitoring phonemic strings produced by his 
conversation mate while the other eye is free to 
observe lip movement and other gesticulations. 
Training would procede more or less as in learning 
a foreign language. Evaluating the size the 
vocabulary learned in a given time period as a 
function of phoneme string quality should tell 
something about the value of such a system for the 
deaf. 

AutOTnated Phonemic Utterance Transcription 

Table 1 contains phoneme strings generated in 
our laboratory from pronunciations of the ten 
digits, each repeated twice. Our research goal is 
to develop a complete ASR computer system, and so 
these strings were produced somewhat as em 
afterthought to illustrate the concept of phonemic 
string rending. 

Our isolated wrd ASR system achieves 99+% 
for lO-word vocabularies for a single speaker in 
real time using only phonemic character strings 
such as those in Table 11 

Speech input is band passed filtered into 6 
octave channels, the highest frequency passed 
being 10 JtHz. The voltage in each channel is 
summed ux^ for 10 ms digitized and sent to the 
computer. This process is repeated every 10 ms. 
The computer is a 16 bit/word, 32K Sign\a 3. ^Vhen 
a new speaker first approaches the Sigma 3, the 
computer requests that he pronounce EVE, AH, ;iET, 
IT, OH, TWO, RRR, MNN, SSS , FFF, VW, HAY, 

(and sometimes other v;ords) . From these words the 
computer abstracts templates (reference jxjints in 
the 6-D filter space) for each of the primary 
sounds in each v;ord and then labels them with the 
charficters E, A, 3, I, O, U, R, M, S, F, 2, V, and 

There is nothing special about the choice of 
prop.ipt words or their character codes. They can 
be altered at will, and v;e frequently increase and 
decrease their number. 

Inspection of the strings reveals that 
similar words produce similar strings. (VS^at 
else?) Clearly more phonemic detail needs to be 
incorporated for general word recognition, but to 
the unaccustomed eye, this would only obscure the 
patterns that do exist; so, the detail was omitted 
for this presentation. 

These strings would probably be too long for 
reading at the typical speaking rate of 200 words 
per minute since the average reader only covers 
250 words a minute where each word has an average 
length of 5 characters (not 50) . Experience 
suggests that these phonemic character strings 
could be reduced to average length 10 with little 
loss of information. 

In considering written phonemic strings as a 
general communication tool, a severe problem not 
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to be neglected is the variability in the phoneme 
strings from speaker to speaker. Most algorithms 
known today would require some sort of speaker 
adaptation. Difficulties in "speaker 
nonnalization** should be investigated early. 

Conclusion 

Automatic speech recognition has taken a long 
time to approach the minimal requirements of cost, 
vocabulary size and accuracy for even the most 
ideally suited tasks* But it seems likely that 
the art has advanced to a point of having utility 
for such applications as speech control of 
machines for the bedridden or paralyzed. If ASR 
is not yet useful, the field should nonetheless be 
watched because utterance recognizers can be 
expected to improve at an accelerated pace for the 
next decade. 

Automatic phoneme recognizers can be b'^ilt 
today that transcribe spoken words into phoneme 
strings. Given adequate instrumentation, it seems 
likely that people could now (or will shortly) be 
able to read these phoneme strings fast enough 
that they could be of considerable assistance to 
the profoundly deaf in following normal verbal 
conversations. 
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TOWARD OPTIMUM SYNTHETIC SPEECH FOR THE DEAF 



by 

R. Lynn Kirlin 
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University of Wyoming 
Laramie, Wyoming 82070 

Sunmiary . Communication theory, and in particular modulation theory, 
is used in conjunction with nonlinear transformations on instan- 
taneous voice envelope and frequency for the purpose of matching 
the synthetic speech to the mapping of an individual's region of 
hearing. The process is straightforward electronically. An . 
example is given which yields an approximately linear frequency 
mapping and an expression for the resulting mean and spread of the 
synthetic voice spectrum. The introduction includes a review of 
the literature which discusses the importance of various properties 
of speech, defines speech as an envelope and angle modulated signal, 
summarizes types of non-conventional hearing aids such as the 
transposer, and discusses the information capacity of the ear. 



Introduction 

Although not a few efforts have been made toward 
advancing hearing aid technology, little agreement is 
discerned in the field as to which method is best in 
all or even in most cases. Aids for speech perception 
include not only auditory but also visual and tactile 
(1) . Hearing loss may sometimes be corrected by 
surgery, but other than this, residual hearing is 
usually utilized with the aid of some type of hearing 
device. Among the users, choice of hearing aid should 
depend upon the recommendations and diagnosis of the 
audio logist. However, "the hearing specialist lacks 
a reliable means of prescribing a hearing aid with 
performance characteristics similar to the ones he 
wants for his patient" and a hearing aid dealer has 
little way of relating those specifications to his 
own wares" (2). In addition, 70% of the wearers omit 
the audiologist and go directly to the dealer. Thus 
the typical commercial hearing aid is not only a 
simple amplifier, emphasizing some or most audio fre- 
quencies, but it also comes in hundreds of models 
from which the consumer hopefully chooses or has had 
chosen for him the best for his particular need. 
Beyond the "typical" hearing aid, several researchers 
in the past ten years have theorized, developed, and 
even gathered objective data on various nonconven- 
tional auditory aids. Among the best known of these 
is the frequency transposer developed by Johansson 
(3). A recent overview of the history of the devel- 
opment and results of this and similar aids is given 
by Pick6tt (4) of Sensory Communications Research 
Laboratory, Gallaudet College, Washington, D, C, who 
also has suggestions for open research areas. He 
states that, "It appears from the present test results 
with transposers that considerably more research will 
be necessary before we know how best to design trans- 
poser hearing aids. It will be necessary to solve 
some very difficult problems, as discussed earlier. 
It will probably also be necessary to take into 
account different individual hearing capacities at 
various frequencies and for different time patterns" 
(4, p. 7), What is meant by hearing capacities was 
indicated by R, Mazeas (5), who divides the hearing 
region into least distinguishable amplitudes and 
frequencies and uses the time constant of the nervous 
system to formulate an individual's maximum hearing 
capacity in bits per second (bps). The number might 
range from 200 bps to 40,000 bps in a severely handi- 
capped case to a normal case, respectively. A device 
called "Le Bitmetre" has been manufactured by a 



French firm to measure this' capacity. It allows 
measurement not only of puretone hearing thresholds 
but also of amplitude (Al) and frequency (Af) dif- 
ference thresholds and time resolution (At), indi- 
cated by the ability to distinguish Lwo successive 
Impulses. Modern hearing aid design should take 
into account such data from each individual wearer. 

The first step in this direction has been taken 
by several devices which at least have moved the 
speech spectrum into a narrower, lower band. Re- 
sults of various aids using transposition are 
reported in several articles in American Annals of 
the Deaf, Vol. 113, 1968 (6) - (9), and Bulletin 
D'AudloPhonologle, Vol. 1, No. 2, 1971 (10). The 
results are varied and even contradictory. For 
example, the Lafon amplifier (10) is reported to 
yield results in lip-reading which "could never have 
been achieved by the classical methods," according 
to a teacher of 26 years experience. Levitt (11) 
distinguishes between two forms of results of the 
newer aids, noting their apparently marginal success 
for perception but moderate success for speech 
training. 

More specifically, types of audio aids with 
other than pure amplification, include the following: 

1. amplification of low frequencies with 
superposition of a transposition of high 
frequencies onto the low band (3), (6); 

2. amplification of low frequencies with 
superposition of amplitude modulation of 
selected medium tones by the envelope of 
selected narrow high bands (6), (10); 

3. amplification of low frequencies with 
superposition of frequency-divided ver- 
sions of selected higher frequency bands 
(7); and 

4. pure synthetic speech generation by means 
of vocoding, or amplitude modulating low 
frequency tones with the envelope of 
higher frequency narrow bands with a one- 
to-one correspondence between tones and 
bands (12). 

As of yet, there has been no hearing aid built which 
maps all instantaneous speech frequencies and ampli- 
tudes into a narrower band of hearing on a one-to- 
one basis for the specific purpose of aiding either 
speech perception or training, although the concept 
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(Duplicated from Pimonow (12)): 

The normal hearing area and the range or domain of speech (crosshatched). 

Hearing area of the semi-deaf. By means of a conventional prosthesis the 
domain of speech can be adapted to the hearing area which is reduced by 
disorders, through amplification, that is to say by a vertical shifting. 



Part c. Hearing area of the deaf. The range of speech is partially adapted by 
selective amplification and dynamic compression. All these methods 
which act exclusively on vertical shiftings of the range of speech are 
at present used in most of the school for deaf-mutes. 

Part d. If losses are very large, a vertical shifting Is not sufficient. It is 

necessary, not only to act upon amplitudes, but also to shift the domain 
of speech along the frequency axis. Any such adaptation amounts to a 
conversion of spoken language into synthetic speech. 

which listeners learned to communicate adequately. 
He thus proved that speech perception could not be 
tied to phoneme characteristics. 



is not new and is displayed in Fig. 1, reproduced 
from (12). (However, Dr. Richard Carr of Raytheon 
has proposed a mapping of zero-crossing information 
using digital electronics, and Dr. George Haspiel at 
Penn State University computerized and verified the 
utility of a similar system in 196^.) The aids 
which use envelopes of high narrow bands to remodu- 
late tones of lower frequencies do not, unfortunately, 
make direct use of the information in the zero- 
crossings of speech, which aro known to contain most 
of the information (13). In addition, the envelope 
spectrum of speech in octave bands has been found to 
have significant frequency content only between 0.25 
and 25 Hz (14), and thus probably contains very 
little information. Morris (13) has explained why 
real zero-crossings contain most of the Information. 

On the other hand, the adaptability of the ear 
to interpret synthetic or even coded or scrambled . 
speech is impressive. Kahn states (15), "Beginners 
in the study of (speech) privacy systems never fail 
to be amazed at the difficulty of scrambling speech 
sufficiently to destroy intelligence. The ear can 
tolerate or even ignore surprising amounts of noise, 
non-linearity, frequency distortion, misplaced com- 
ponents, superposition, and other forms of inter- 
ference," An example of such distortion compensation 
was shown by Blesser (16) who employed a system that 
totally inverted the speech spectrum so that high 
frequencies became low and low became high; and by 



The method of speech compression that seems 
most desirable is one which compresses instantaneous 
frequencies and also operates on the envelope such 
that the resulting synthetic or distorted speech 
bandwidth fills the reception band of the deaf indivi- 
dual. A scheme for performing these operations is 
indicated by M. R. SchrOeder and J. L. Flanagan of 
Bell Laboratories (17). By dividing instantaneous 
frequency by two and taking the square root of the 
envelope and combining the results, they showed by 
computer simulation that speech bandwidth had been 
reduced by a factor of two, and were encouraged that 
the possibility of higher compression ratios might 
be feasible. The spectral results of frequency 
dividing and filtering hard limited speech are shown 
by Bogner (18) to give acceptable results for band- 
width compression, with some possibly objectionable 
phase ambiguities upon decom{>ression. 

The extraction of a voltage proportional to the 
instantaneous zero-crossing frequency is no longer 
a difficult hardware problem due to the manufacture 
of complete phase-locked loops (PLL) on a single 
electronic integrated circuit component, and either 
the linear or non-linear but monotonic mapping of 
that instantaneous frequency to another is a simi- 
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FIGURE 2. Possible non-linear frequency 
compression characteristics. 
Output frequency f vs input 
frequency f.. 



larly simple process. Miniaturization of digital 
circuits provides another method. The resulting 
spectrum could also be amplitude shaped or frequency 
distorted as desired with some custom, but simple, 
tailoring In the analog case. For example, someone 
with normal hearing which has deteriorated at high 
frequencies may be fitted with a gradual compression 
and/or amplification at higher frequencies. This 
would be the frequency transformation shown in Fig. 
2a. The keys to any serious attempt to optimize 
synthetic speech are threefold: (1) measuring the 
hearing capacity of each individual with a device 
or technique such as the "Bltmetre," <2) extracting 
the Instantaneous envelope a(t)>0 and frequency 0(t) 
from voice v(c) for generation of a new signal s(t) 
with envelope b(t) and frequency y(t) which are 
matched to the individual, and (3) trading theoreti- 
cal possibilities of receiving "information" with 
the practical difficulties of- re-learning new speech 
sounds. (For example, a person with old-age hearing 
loss should obviously not be required to relearn a 
totally synthetic speech; only that necessary part 
of speech which he can no longer discern should be 
receded.) 

Such remodulatlon implied by (2> above might be 
optimized through the use of the theory of simul- 
taneous envelope and phase modulation as presented 
by Kahn and Thomas (19). This requires first that 
the statistics (power spectral densities, auto- 
correlations, amplitude densities, cross correlation, 
covariance function) of a(t) and ^(t) be found. To 
this author *s knowledge this has not been done. 
Other useful statistics would be those of the zero- 
crodsing rate Z^(t) of speech and the zero-crossing 
rate Z^(t) of the derivative of speech. The ampli- 
tude densities and autocorrelations of voice and 
Zj(t) have been found, however (20), and the 



spectrum of the envelope of voice in octave bands 
has also been found (14) . 

Optimum Modulation for Synthetic Speech 

Assuming that the above statistics ar^ known 
and that the envelope a(t) and frequency* ^{t) of 
voice v(t) are available in the form of an analog 
voltage (or an analog-to-digital converted form), a 
voltage-in-voltage-out transformation can be syn- 
thesized to yield new envelope b(t)>0 and frequency 
Y(t). For example analytic signal rooting (17) 
yields 

f <t) = a^^"(t) cos[c|>/(t)/n] , 
1/n 

which is a signal having approximately (lyn)th of 
the bandwidth of v(t). While bandwidth has been 
reduced, however, it has not necessarily been re- 
duced optimally. Before any such "optimum" s(t) 
could be synthesized, knowledge of its spectrum 
would be necessary. To begin, let voice be single- 
sidebanded to u) : 



v^(t) = a(t) cosCto^t + 0(t)], 



and let 



s(t) = b(t) cosCtu t + Y(t)]. 
c 



(1) 



(2) 



The positive frequency components of s(t) around u) 
are given by 



x(t) = Ssb(t) e 



jY(t) 



(3) 



which is not usually a real function of time but in 
general complex. The bandwidth of s(t) around O) 
is the same as that of x around the origin and miy 
be defined by (19): 



where $ (f) is the power density spectrum of x(t), 
and 



||x(f)||=[j" |x(f)|2df]^ 



In terms of the autocorrelation R (t) of x, the band- 
width is ^ 



R^(T) 



(5) 



T=0 J 

which is also equivalent with 
|2, H 



Edxr} 

E{|x|2} 



(6) 



where £ denotes expectation. Assume now that the 
root mean square bandwidths of b(t) and Y(t) are 
known and are denoted A, and A , respectively. 
(That Is, for example, ' 



Vrom (17), a(t) = [v^(t) + v^<t)]^, and Ht) » 
tan-^[v(t)/v(t)], where v(t) is the Hilbert trans- 
form of v(t) . 
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^ = !if[*i,(f)rii/||c*b<oril .) 

Then Kahn and Thomas (19) show that 

= + E{bV>/E{b^} , (7) 
and further, that if b and Y are independent, 
a ^ = A, ^ + E{y^}A ^ 

X D Y 

= + E{;^} . (8) 
The spectral mean is also given: 

= E{bbY}/E{b^} • (9) 

Expressions (7) - (9) may be used to determine 
the bandwidth and position of any synthetic speech 
formed by transforming the envelope and instantan- 
eous frequency of real voice. Such a system is 
shown in Fig. 3, where voice is first single-side- 
banded to produce Vj^(t). The envelope eCt) = a(t) 
and instantaneous frequency f^ = ^ are then ex- 
tracted. The voltage analogous to frequency passes 
through an attenuator or nonlinearity to frequency 
modulate a carrier which is also amplitude modulated 
by the original envelope. The resulting angle-and- 
amplitude modulated (AAM) signal may then be beat 
down to a new desired center frequency in the band 
of residual hearing. In this example, b(t) =» a(t), 
and Y(t) may be simply proportional to $(t) or 
perhaps related by yit) = k log (1+4') where k is a 
constant. 



In practice ^ may not be 
2j(t), the zero-crossing rate. 
The zero-crossing rate (t) o 
voice is also easy to produce 
desirable to work with due to 
ibility of differentiated and 
normal ears (21). If no ampli 
performed, i.e., if b(t) = 1, 
will have a spectral width giv 
terra in expression (8). 



easily obtainable, but 

is easy to produce, 
f the derivative of 
and may be even more 
the greater Intel lig- 
clipped speech to 
tude remodulation is 
the synthetic speech 
en by only the second 



Having determined roughly where the synthetic 
speech frequencies are for given transformations of 
a(t) to b(t) and ^(t) to Y(t), the question is, 
"What transformations are desired?" If we had 
complete control of the demodulation (the human 
brain) we would consider the ear and its nervous 
system simply as a channel through which we would 
like to communicate n bits per second, and the sig- 
nal could be designed optimally according to the 
channel characteristics. In particular, if we 
considered the ear a linear channel with only a 
threshold (the threshold of hearing), a saturation 
level (the threshold of pain), and an ideal passband 
(indicated by the intersections of the above two 
threshold curves vs frequency), then in the presence 
of a fixed gaussian noise level we would distribute 
the transmitted information evenly within those 
boundaries. Thus, ideally, the joint probability of 
each envelope amplitude and instantaneous frequency 
would determine their information content and we 
could so code b and Y to yield a uniform distribution 
across the usable portion of the frequency-intensity 
characteristics of the ear. 

However, the true situation is not nearly that 
simple^ and synthetic speech must take into consid- 
eration several facts: 

1. The ear channel has a non-uniform "noise" 
amplitude in the form of least-distinguish- 
able-difference thresholds of intensity 

Al and frequency Af at every point in the 
usable hearing region (5). 

2. The threshold of hearing vs frequency 
curve is usually determined by pure tone 
testing, which in some cases means that 
although the deaf ear might not linearly 
respond to that tone, distortions may be 
sensed due to a high enough input level. 

3. Natural hearing indicates that some mono- 
tonic mapping of $(t> onto Y(t) seems 
reasonable; i.e., a gross shuffling of 
input vs output Instantaneous frequencies 

by the synthesizer does not seem appropriate* 

4. Time-distorted speech is also not practical 
for obvious reasons. 
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FIGURE 3. 



Prodaction of frequency compressed speech by 
extracting envelope e(t) and instantaneous freq- 
uency f| from voice v(t), aided by single-side banding. 
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5. Many hearing problems are of the high 
frequency hearing loss type, and the low 
frequency portions of speech have already 
been learned. 

With the exception of item (2) above, which cannot 
be accounted for with linear system theory, a rea- 
sonable solution seems to be as follows. Let the 
mean of the envelope lie In the mean of the accept- 
able Intensity region, and the amplitude density of 
b(t) be essentially confined to acceptable Inten- 
sities. Thus let 

b(t) = k^a(t) + , (10) 

where Is the mean acceptable intensity. 

At this point, note that the frequency content 
of b(t) is small, on the order of 0.2 to 25 H2 (14). 
This means that the spectral width of s(t) will be 
due essentially to yCt) . If an individual's Af is 
particularly large near frequencies f^, i *= lf2,...,m, 
let the mapping of $ to y "avoid" those frequencies, 
thus compressing -y into only regions with smaller Af . 
(See Fig. 4). If the nonlinearity in y(i) is not too 
great, y is approximately given by 

Y = ' ^^^^ 

where f^ would often be negative, assuming all (f) are 
positive and a down-shift of frequencies is needed. 
Using (10) and (11) in expression (8) gives the 
approximate bandwidth; note that 

e{y^} - E{(J2} + ^ j^^f^^^^} ^ 

If fi^<k^,k2) is too large, a smaller k^ may be 
chosen. 

More ideally, an amplitude transformation would 
be designed similar to the frequency transformation 
such that amplitudes b(t) would lie in regions of 




large Al only with small probability. With comput- 
erization, a joint mapping would shape the joint 
probability density of b and Y such that only rare 
combinations would occur in a region of both large 
AI and large Af. 

For the person with a high frequency hearing 
loss, a gradual nonlinear transformation of fre- 
quencies might prove best. For example, let 

y = log(l+k3l) 

. - k3^ - + - . (12) 

This transformation allows low frequencies to remain 
nearly unaltered, but compresses the highs. With an 
analog implementation a simple control would allow 
the individual to vary k^ to his liking. Although 
such a device has not been tested, it seems that the 
resultant synthetic speech would be perceived to be 
more natural than that of the transposer, which is 
not a one-to-one mapping of frequencies, but an over- 
lapping of highs onto lows. 

In addition to the mapping (12), pre-dif f eren- 
tiation of speech or post-high-frequency emphasis 
should be useful for the high-frequency loss user. 

Conclusions 

It is realized that the major obstacles in 
determining the utility of synthetic speech devices 
are not la their engineering, but in their appli- 
cation to humans, and it will be the field and 
educational testing that will prove their worth. 
Nevertheless, this paper has attempted to introduce 
more technically sound approaches toward synthetic 
speech generation. These approaches not only com- 
press the voice spectrum, but do so with an attempt 
to match the synthetic speech with more detailed 
information about the capacity of the individual's 
ear other than bandwidth and hearing threshold, and 
in addition, take into account the human learning 




FIGURE 4. Transformation of ^ to y which is compressed 
into the reception band (fj^ f ^ f,^) and avoids 
frequencies f| and fg which have large frequency 
difference thresholds Af. 
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process. It Is also assumed that previous advance- 
ments in hearlng«-ald technology would be incorpor- 
ated into any newer devices. For example, automatic 
volume controls, noise level thresholds, and even 
directional "phased array" microphones should also 
be used to advantage. The trade-offs between 
theoretical and practical gains in information 
reception roust be studied as well. This implies 
not only building devices but designing and imple- 
menting objective programs whose results allow 
feedback for redesigning the device's functions and 
directing their use to individuals with a higher 
potential for adaptation. 
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Abstract. Two problem areas are discussed in the development of a practical 
road vehicle to be driven by a severely disabled person. A unique wheel- 
chair lift to facilitate entry and exit from the vehicle is described. 
The lift can be operated safely and independently by the disabled person 
in a large variety of parking situations. 

An electro-hydraulic full power control system is pi^oposed which 
would allow control "handles" suitable for a wide range of disability. 
Unusual control transfer functions are considered as a means to produce 
adequate performance with reduced dexterity and help filter out "manual 
noise", as well as make possible improvement in reliability and cost. A 
discrete rate steering transfer function which could provide these advan- 
tages is proposed, and a computer simulation to investigate its suitability 
is described. 



The development of a highway vehicle for independent use by a severely 
disabled individual involves several problem areas, two of which will be 
discussed in this paper » The work presented is by no means the final 
result, but represents the initial efforts on a project that it is hoped 
will yield a practical vehicle. 

Classifying the Driver 

For purposes of this paper, a severely disabled driver will be consid- 
ered as one who is unable or only marginally able to operate existing 
commercial mechanical controls of the type commonly installed in automobiles 
for the disabled. Many specific causes of disability may produce manifes- 
tations which require new approaches in order to allow independent use of 
a highway vehicle. High level traumatic quadriplegics and polio quadri- 
plegics are two common types of persons needing extended techniques. For 
these drivers problems other than operating the vehicle driving controls 
will exist. A power operated wheelchair will be needed for effective short 
distance mobility and thus must be available for use at the destination of 
a trip. They will generally not be able to independently transfer them- 
selves into the vehicle. They will be sensitive to inertial forces while 
driving and thus require a means for restraint. 
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The Mobility Problem 



Short distance mobility needs for the severely disabled are usually 
met with some form of power operated wheelchair. Though coiasiderable 
mobility is afforded, many limitations exist with cominercial wheelchairs. 
For the able-bodied, medium range independent travel may involve the use 
of a bus, a train, or a cart But, these modes are not available to an 
individual wko requires a powered wheelchair. By imposing on firends or 
relatives it is possible to get from place to place with a car or van type 
vehicle, but considerable physical effort is often required of the person 
helping. No satisfactory means for independent medium range mobility is 
available at present. With but two notable exceptions, the BART system 
and the Washington, D. C. subway, urban mass transit is not usable and will 
be such for many years. Several commercial taxi services have been estab- 
lished for the disabled. While these may provide a partial solution 
particularly for the very severely disabled, they tend to be expensive and 
not able to give sufficient mobility for everyday affairs • One solution to 
the medium distance mobility problem would involve the use of a highway 
vehicle with special features that permit independent operation by a 
severely disabled person. Two research topics in the design of such a 
vehicle will be discussed in this paper, the entry-exit system and the 
characteristics of the vehicle control system. 

Entry-Exit System 

Since the driver considered in this paper is unable to transfer him- 
self from his wheelchair seat onto a conventional car seat without assist- 
ance aad many severely disabled would prefer not to leave their personalized 
wheelchair(l) , driving from a wheelchair is assumed. A vehicle which will 
accommodate the wheelchair and a means for entering the vehicle must then 
be specified. Because of problems with headroom and space to position the 
wheelchair, a small step-in van is one of the few practical vehicles avail- 
able. Though a step-in van lacks many of the handling and esthetic quan- 
tities of other vehicles, modification of existing structures is minimized. 

Lift Philosophy 

A practical wheelchair lift for a severely disabled person must satisfy 
a number of constraints. Because of the driver's general lack of strength, 
all mechanisms must be power operated. While it is true that certain indi- 
viduals may be able to manually accoii5)lish specific tasks such as closing 
doors, there are parking situations where these tasks cannot be done or may 
be dangerous. To be truly practical the lift should function reliably under 
a wide range of parking situations, such as uneven terrain when the entering 
wheelchair may not be at the same attitude as the vehicle. 

The wheelchair must be restrained and maintained level or tipped slightly 
back to insure safety of the driver. This requiVt^ment results from a 
common inability to balance found with the severely disalled. Good engi- 
neering practice requires that all conceivable failure modes be such that 
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adequate warning is given. It is thus assumed that the driver will peri- 
odically inspect the physical condition of the mechanism. The construction 
techniques and components used should be of a type thai: allows ready niain- 
enance without the need for special equipment. 

Lift Designs 

A ramp is the simplest means of access to a van and many designs are 
available commercially, some with a power folding feature(2). But, a ramp 
hiii^ many obvious disadvantages for a severely disabled driver. 

The application of a platform lift to the problem of vehicle entry 
allowed for a measure of independence for those with sufficient strength 
and ruotion to operate conventi-onal hand controls, ll^ese platro/ja 111 ts are 
adaptations of the familiar tailgate lift used on delivery trucks. The 
lift is powered by an electric motor or hydrauli cally through an electric 
motor driven pump or a pump on the vehicle engine. Several coinmon commer- 
cial platform lifts use a cylinder and chain to elevate t])e platform, 
which is guided by two vertical channels. A cylinder and swinging arm 
linkage are also used occasionally. 

In use the wheelcliair is rolled onto tlie platform, which extends out 
from the vehicle. The platform is raised to floor level,, and the wheel- 
chair is rolled Into the vehicle. The platform is tlien stowed by folding 
it up against the side of tlie vehicle* This folding process must often be 
done manually, unless power operation is added by the owner after purchase. 
At least one manufacturer calls for mounting tlie entire lift meclianism 
externc Ily wher^: it may easily be damaged and can become a ha^.ard. 

A variation on tJie platform lift is used by the Reiiabili tation-Educa- 
tion Center at tlie University of Illinois on tlu^ir fleet of buses, which 
operate on a regular schedule year round. llie platform is actually part of 
the J'loor whicli moves out and down supported by four arms as shown in 
Figure 1. 

The platform type lift has several disadvantages. A practical problem 
results when the entering edge of the platform is not flush with the 
ground, producing an effective step wliich the wheelchair must negotiate. 
This condition can occur for example with a heavily crowned road or an 
obstruction such as a rock or accumulated snovs^. Adequately restraining 
the vlieelchair wliile it is being lifted may pose a problem. The physical 
dinxinsions of the mechanism itself may be difficult to accommodate in a 
personal size vehicle without obstructing vision or movement, although 
visibility when the lift is stowed can be improved somewhat by using a 
platform conposed of two channels for the wheels. 

/Vnother approach to entering a vehicle involves lifting the wheel- 
chair from the back wiuh a mechanism that engages the structure of the whcel- 
ch'ai,r itself. This approach was developed at the Coordinated Science 
Laboratory (CSL) and will be. described In detail in thie'next section. A 
group ar the University of California at Berkeley is developing, under an 
HEW Grant, the concept of a lift which will place a uniquely designed 
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FliUJRE ].. Vni vcrsi ty of Illinois Rehabilitation Center lift 
mechanism . 



wheelchair into the driver's position of a standard size auto (1,3). Thi 
design transfers the wheelchair, which has engaged two forks on the lift 
and then raised its wheels, backward from the passenger door side into 
the vehicle, over the drive tunnel and into the driver's location. The 
Berkeley lift as outlined would require a complex md expensive mechanism 
and no prototype development has been attempted to date. 

CSL Lift Design 

The CSL lift design is an attempt to meet the needs outlined above 
without the disadvantage.^ of a platform lift. 
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In operation the CSL two bar lift rairaics the technique used to manually 
pull a wheelchair up a series of steps. The hand grips on the back of the 
wheelchair engage a bar on the lift. The chair is tilted back, rear whcel.^ 
resting against another bar. Then the chair is pulled up. 

The manner in which the lift holds the wheelchair is shov.ni in Figure 2, 
v/here the arrovjs indicate the direction of the forces applied to the ciiair. 
The center of gravity (e.g.) shown will vary with the model wheelchair and 
the Individual. All calculations in this paper are based on the dimensions 
of an Everest and Jennings Model 840 Adult Power Drive wheelchair. The 
lift will function with other models including manual wheelchairs, but may 
need slight dimensional adjustment for best operation. An adjustment 
capability can be easily provided in the hardware design. 

The lifting sequence is shovjn in Figure 3 (a)-(c) v;here the lift is 
mounted on a van door, which is opened 90 degrees. Notp that the wheel- 
chair is automatically aligned vjith the lift during the engagement phase, 
Figure 3 (b) . This feature permits safe use of the lift when the chair 
is not at the same attitude as the vehicle. In the extreme case the chair 
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FIGURE 3. (a) Wheelchair backed into position with hand grips 
over lifting bar. 
(b) Tension of lift cables raises slide rails until 
bar contacts hand grips. Additional tension pulls 
bar back, tilting chair. 
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can be lifted with only one hand grip engaged if necessary, as long as both 
hand grips are between the vertical pivot arms. It is possible to lift 
from a leyel below the road level or to pull the chair up a small curb or 
over an obstacle. If the engagement condition for safe lifting is not met, 
the resultant tilt will provide immediate warning. Engagement from and 
release onto uneven surfaces are slow, and thus do not introduce sudden 
imbalance problems for the occupant. 

The forces on the wheelchair were calculated using Figure 4 in order 
to set the design dimensions for the lift. Consideration was given to 




the magnitude and ratio of forces on the wheelchair hand grips in order 
to insure reliable engagement of the lift and minimize strain on the back- 
rest frame. For a specific wheelchair and occupant, these forces are 
determined by the tilt angle, Y, of the chair from vertical and the angle, 9, 
made by a radial liner through the lower bar contact point on the wheel and 
a line parallel to the x axis of the chair (see Figure 4), 

Straight forward analysis yields the following relations 



W (A+B)cosG - W (Asine+DcosG) 

F = —2 S 

X Asin8 Jr Ccos9 




FIGURE 5. Basic two bar post lift. 
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FIGURE 6. Two bar post lift installed in a van, 



F = 

y 



W (D-C)sine +W (Ccose-Bsine) 
Asine + Ccos9 



and 



W (C-D) + W (A+B) 
w Asine + Ccose 



where 



W = W sin Y 

X 

W = W cos ¥ 

y 

W s= weight of wheelchair and occupant 
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Two Bar Lift Prototypes 



Two prototypes of the two bar lift have been constructed. The first 
and simplest mechanically was intended for mounting on a vertical post such 
as a hydraulic cylinder rod in a vehicle. The basic mechanism is shown 
in Figure 5. Note that the two bars are rigidly connected and pivot about 
a point above and forward of the wheelchair center of gravity. The bars 
are normally held up against a stop by a spring. During engagement .of the 
chair, weight on the upper bar causes the two bars to pivot pushing the 
lower bar forward against the rear wheels. As the upper bar assumes more 
weight, additional pivoting of the bars gives the chair a rearward tilt 
until a stop is encountered whereupon the chair is lifted. When a suitable 
height is reached, the lift and chair are swung into the vehicle, and the 
chair disengaged. A possible installation is shown in Figure 6. With 
this configuration entry would be possible from the street behind or from 
the sidewalk next to the vehicle. The prototype post lift shown in Figure 7 
was permanently mounted on a column in a garage and manually operated. It 
is shown here being used to enter a step-van. 
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FIGURE 7. Prototype two bar post lift. 
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FIGURE S. Two bar door lift haing used to enter a van. 



The second prototype two bar lift, like the design in Figure 3, was 
mounted on the right side door of a van. The entry sequence is shown in 
Figure 8 (a)-(c). In Figure 8 (a) the chair is being backed into place. 
The upper bar, held away from the door by springs that counteract the 
weight of the lift frame, is positioned under the hand grips. A button on 
the remote control box is then pushed causing the lift cables to be wound 
up on a drum. The lift raises on the door until the weight of the chair 
begins to bear on the upper bar. As the cables continue pulling, the weight 
of the chair is transferred to the upper bar causing the bar to pull back 
as the springs are compressed, thus aligning and tilting the chair. Note 
that with the door lift the chair tilts about its rear axle. The chair 
is being raised in Figure 8 (b) . When floor level is reached another button 
would be pushed closing the door as in Figure 8 (c) . The door closing 
mechanism has been designed but has yet to be installed. After the door 
is closed, the chair is lowered and disengaged by reversing the sequence 
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above. The lift is then stowed by winding the cable up until the upper bar 
has been pulled against the frame. 

The typical time required to enter the vehicle is under a minute and 
a half, with the lift itself needing fourteen seconds going up and ten 
going down. The mechanism is compact when stowed, being thirty-one inches 
wide and less than nine inches deep (this can be reduced to about six 
and a half inches with slight changes). It will accommodate chairs with 
tires up to twenty-six inches apart and will lift chairs from three inches 
below road level, it will also lift the driver up over a parking- lot curb 
as much as six inches out from the lower bar. 

Power for the entry system is supplied by a commercial electrically 
driven hydraulic power unit connected to the vehicle battery. The lift 
cable winding drum actuator is a small hydraulic motor on the door. The door 
closer mechanism will use a cylinder mounted under the floor. Solenoid 
valves, mounted in the old step-well along with the puinp, control fluid flow. 
These are operated by an umbilical control box or alternately in the future 
by a wireless hand held unit. A diagram of the hydraulic system is shown in 
Figure 9. 
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FIGURE 9. Hydraulic and control system of prototype door lift. 
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Considerable attention was given to reliability and safety in the door 
lift prototype. The dimensions are such that a three and half degree back- 
ward tilt of the chair occurs on level pavement. Under these conditions a 
vertical force of two hundred thirty pounds and a horizontal force of sixty- 
five pounds would be applied at the hand grips producing a relatively small 
bending moment on the backrest with the chair and occupant shown in Figure 8, 
Calculations indicate that the foirces produced on the grips would be accept- 
able for over fifteen degrees of tilt in either direction; however the 
occupant may not be stable for forward tilts. The hand grip stops are 
securely clamped to the steel tubing but could be welded for permenent 
installation. These stops can be quickiy attached by removing the plastic 
grip and tightening the clamp. The materials used were conservatively rated 
and of a readily available type whenever possible. The vehicle door was 
strengthened with another hinge and two horizontal plates* Hydraulic system 
features include (see Figure 9) a counterbalance relief valve to support 
the lift load against falling under any condition of valve or pump operation. 
The door actuator will be relieved at low pressure to prevent damage and 
allow manual opening of the doors if the power system fails. Manual opera- 
tion of the valves is possible permitting the lift to be lowered by someone 
else. 

Vehicle Control System 

Driver Capabilities 

As stated earlier the driver being considered would be unable to effec- 
tively operate the mechanical hand controls now available. There may be 
several reasons for this functional limitations. Insufficient strength may 
be available to provide the forces needed to operate the mechanical linkages. 
Only a small range of motion may be useful making movements such as turning 
a standard steering wheel impractical. Involuntary motions may interfere 
with voluntary actions. The driver can be modeled as a system with inputs, 
outputs, and some form of transfer function. Here a full range of inputs, 
visual, aural, and kinesthetic, are assumed; though the kinesthetic input 
may be limited in information capacity with some disabilities. The outputs 
are sharply limited in capacity and may contain some noise such as involun- 
tary motions or inertially generated signals. The outputs may also have 
small dynamic range or lov resolu tion. The true form of the transfer 
function is complex and beyond the scope of this paper; though it is expected 
that work will be done in this area in the future. Here only a simple form 
will be used, thus the theoretical results obtained may be inferior to the 
performance of a human driver. 

A Steering Control System 

The control system must be able to account for the limitations above 
and still allow adequate performance for driving. Many possible approaches 
are available. Full proportional control is commonly used in aircraft and 
auto systems* A hyd^'aulic servo with electronic augmentation has been 
used to increase the dynamic range of control. handles. Though a proportional 
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system of this type is capable of very good performance, the servo valve 
used introduces reliability as well as cost problems (4). Thus a propor- 
tional servo system was rejected as a candidate for the vehicle steering 
system. 

Another approach which has been used successfully in other applications 
and has advantages due to hardware simplicity is a discrete rate control. 
The inputs to a road vehicle steering control could be like those in 
Figure lOa with the resulting steering angle response shown in Figure 10b. 
The choice of discrete input from a given set of discrete values determines 
the rate of angle change in the front wheels. A specific wheel angle is 
achieved by allowing the motion to integrate for a sufficient time period. 
Thus by choosing the rate from a fixed set and picking the corresponding 
length of time for that rate, any angle may be traversed. The hardware 
advantage results from the replacement of the precision servo valve of the 
previous approach by five simple solenoid valves and two flow control 
restrictions. A possible two rate system is shown. Figure II. Because 
these valves produce only an on-off action and do not require the precision 
necessary for thro tt line, it is expected that an order of magnitude increase 
in reliability and a similar decrease in cost might be achieved. The system 
can be simplified even further by replacing the five valves with two 4-way, 
three position valves plus flow control restrictions. It is recognized 
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FIGURE 10. Response of a discrete rate control system. 
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FIGURE 11. A possible two rate control system. 



that a discrete rate system will produce a response inferior to that of a 
proportional system; however the improvement in reliability and cost made 
this type of system of interest. 

The feasibility of a two rate control in steering an automobile was 
tested using an electric motor driven mechanism attached to the steering 
wheel of a 1967 Buick stationwagon with conventional power steering. The 
rate and direction of steering wheel rotation were chosen by applying 
voltage to the motor through a five position joystick. The values of 
voltages, and thus the steering wheel rotation rates, were picked subjectively 
by trial and error for the driving situations encountered. Though the mech- 
anism was crude with backlash and slippage, adequate control of wheel motion 
was achieved over several runs using two experienced able-bodied drivers 
and one inexperienced disabled driver. The experienced drivers reported 
adequate control of the vehicle was easy in city driving. The most difficult 
driving occurred at high speed where the magnitude of the slow rate limited 
the maximum drivable speed, though one driver claimed good control up to 
70 mph. The inexperienced driver though not provided with a control for 
braking and acceleration was able to effectively steer through city streets 
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and park in a head-in situation. The only difficulties encountered resulted 
from not being accustomed to the size and turning radius of the vehicle* 

The positive Indications from this crude test along vith the potential 
benefits noted above prompted an attempt to optimize the design of a 
discrete rate steering control system for the vehicle. The problem then 
reduced to finding the number and magnitudes of the steering rates that 
would allow adequate perfoxrmance over the range of driving expected* The 
subsequent optimization produced an initial result for the two rate case 
using a simple man- vehicle model. 

Driving Performance Index 

A figure of merit or performance index must be defined in order to 
indicate in what sense performance is to be evaluated. A measure of error 
was used as the index and thus was minimized. For simplicity the performance 
index was applied only to describing a single turning maneuver. Data was 
taken of the front wheel angle versus time for several able-bodied male 
drivers executing turns in normal city and expressway driving with a 1970 GMC 
step-van donated for the project. Inspection of the data showed a close fit 
to a function composed of a fixed combination of constant segments and time 
varying segments of the form: 
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Figure 12 shows a comparison of the idealized function with data from an 
actual turn. The performance index judged the perfoinnance of the modeled 
system against the idealized function for the turns specified by the A and 
B values taken from the actual driving data. 

A subjective evaluation of desirable performance yielded an index of 
the form: 



J(x,x> = Wc^T) + Pe^W "^-^ + Re^^^ax + s(|) + e^(t)dt 

o 

where x = set of parameters to be adjusted 

-5 set of parameters describing the turn 
e(T) = final lateral position error 

C = magnitude of the maximum lateral position error 



73 




Time 

Idealized Wheel Angle Function 



9 




Time 

Actual Wheel Angle Data 



FIGURE 12. Idealized and actual front wheel angle function. 



A = magnitude of the maximum lateral acceleration error 
max 

N = number of control inputs in time T 
W,P,R,S,Q = weighting constants 

The error function €(t), A, and N were generated by a computer model 
of the man-vehicle system executing an idealized turn with parameters y. 
The choice of the performance factors and their penalties was motivate'3' by 
the following arguments. If one considers the situation of turning into 
a narrow space, then deviation from desired position at the completion of 
the turn can be significant. An exponental penalty was applied to the 
maximum deviation from the desired path for errors over two feet since 
keeping the vehicle in its lane may be of paramount importance. m Lateral 
acceleration can be a measure of smoothness of control and must be kept 
within bounds to eliminate skidding. The maximum deviation of the lateral 
acceleration from the desired value was then given an exponential pentalty 
for errors over O.IG, where the vehicle model speed for all turns used 
was set to allow a maximum lateral acceleration of The number of 

distinct driver motions per unit time was included as a consideration for 
driver effort. Lastly, the integrated square of the error was used to 
help reduce wandering or oscillation about the desired path. 
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For the type of control system being developed the steering rates must 
be set to some fixed values, yet they must permit adequate performance over 
a continuum of curves from a slow speed street corner to a high speed express- 
way lane change. Thus the rates must be optimized such that the worst 
performance over the range of turns is as good as possible, in other words 
a minimax optimization procedure is needed (5) . 

Driver- Vehicle Model 



Because the minimax optimization required considerable computer time 
to run, a reasonably simple but adequately descriptive model was needed to 
allow a practical solution on the computer available, a CDC 1604. Two 
models were developed and the most descriptive, the threshold model, used 
in the optimization. 

As shown in Figure 13, the threshold model describes the driver's judge- 
ment in terms of set of error level thresholds. A continuous decision is 
made on the composite error using the nonlinear error thresholds shown, the 
driver picking a steering rate from the available set which is appropriate 
to the error conditions observed. The selected rate is held for Tp min 
(0.05 seconds) which is the minimum pulse length that a driver might reason- 
ably produce, based on the shortest dot produced by a telegraph operator 
sending at 20 words per minute. The resulting steering rate command is the 
input to the vehicle dynamics, where V is the vehicle velocity and W is the 
wheelbasG. Note that no reaction delay is included, as a trained driver's 
prediction capabilities are assumed to make delay errors insignificant (6), 
The front wheel angle response of the threshold model is shown in Figure 14 
with two possible steering rates. Though it is recognized that this is 
somewhat crude by the standards of current research, it was felt that a 
suitable approximation to observed behavior could be made using a simple 
threshold model, thus avoiding more complex approaches such as estimation 
theory models (7). 

Th'^ optimization of the model performance involved minimizing the 
p^rforma.ice index with respect to the rates, error thresholds, and time 
constant t and maximizing over the range of probable turns. 

Minimax Algorithm 

In a typical minimax problem it is desired to find the solution vectors, 
(^y)(^)> such that 
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FIGURE 13 » Threshold model of driver-vehicle system. 
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J ( x^- 5 y ''^ ) = ni i n max J ( x , y ) 

where J(k^^i) is the performance index of the system. In an attempt to solve 
this problem with reasonable convergence and reduce the effect of discon- 
tinuities v;ith respect to x in J j a straight forward minimax routine 
was developed using an available modified Rosenbrock rotating coordinate 
minimization subroutine (8). 

A simplified block diagram of the logic of the algorithm is shown in 
Figure 15. The minimax routine begins by prescribing the finite admissible 
space of ^'s, Y, the upper and lower componentwise bounds for x, Lajb], and 
a minimization parameter, A. The initial value of M(x,^) is then calculated 
for the initial guess x^ , where ^ 
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FTr^liui: ] 5 . si rnpli fi ed mini max a] gori thm . 



M(x ,y) = max J(x ,y), yeY. 



A new guess for ^ is made using the modified Rosenbrock algorit and 
checked for satisfaction of the given boundary constraints, [a^bj. An 
admissible guess is then used to calculate ^{y^^^^i^X) ' this new guess 

decreases the maximum, it is used in choosing the Rosenbrock coordinate 
directions and thus future guesses for ;k. If it does not decrease the 
maximum, the differeuce of this guess, ^£^4,]^ > and the current point, x^j^ ^ is 
compared with the minimization tolerance, A. If the difference is less 
than A, the routine ends with as the minimax solution. If the difference 
is not less than A, a new is made with x^^ unchanged. 
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Results of the Qptimi7:ation 



The set Y contained eight turns specified in the form 

^ Lbj 

where A and B are parameters of the turns. Discontinuities in and 
a considerable number of local minima in M(x,;^ were encountered during 
execution of the routine. These resulted largely from the discrete Y and 
the discontinuous nature of the driver- vehicle model. Several initial 
points were tried and decreasing sequences of A's were used to broaden the 
region of the Rosenbrock search. However there is no assurance that the 
minimum point selected is even the regional minima. 

The solution for the two rate case is the best of the minima found. 
For this solution the weighting constants in J(x,y) were 

W = 500. 
P - 20. 
R = 10. 
S = 750. 
Q = 1. 

The initial point was 

x^ = (9.0, 20.0, 0.3, 1.0, 50,0 
= (E^, E^, R^, R^, T) 

where E^ and E2 are the error thresholds corresponding to the rates Rj^ and 
R2 respectively and t is the feedback time constant. The minimax solution 
was 

X* = (22.83, 95.04, 0.2191, 1.139, 50,00). 

Thus a rate set of 0.?^91 rad/sec and 1.139 rad/sec of front wheL rotation 
results in a local minimax solution for the threshold model. Though it may 
be possible to find a better solution, this solution could be considered 
a "suitable candidate" for a system if it can be shown that satisfactory 
performance is produced (9) , 

The performance of the modeled control system at the above solution 
point can be seen in Figure 16 for two turns. The upper left plot is the 
front wheel cngle response for a sharp turn at 7,7 mph and the upper right 
plot is the corresponding lateral position error. The jagged line in the 
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FIGURE 26* Response of driver-vehicle model for the optimal 
two rate case. 



left plot is the system response while the smooth line is the idealized 
response. The maximum lateral position error during this turn vas 0.6 feet 
and the maximum lateral acceleration error was 0.025G. The lower left plot 
shows the wheel angle response for a shallow maneuver at 31.1 _mph with the 
corresponding position error on the lower right. Here the maximum position 
error was less than a tenth of a foot while the acceleration error was 0.115G. 
The other turns used in the optimization produced similar results with the 
largest position error being 0.9 feet. 
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In general the performance of the locally optimal two rate control is 
considered adequate for conservative city driving. However, higher speed 
expressway driving performance may be marginal at times with considerable 
driver fatigue possible as a result of the large number of small corrections 
needed combined with the reduced physical capabilitic^s of specific drivers. 
Additional rates could be provided to improve perfor-nance here. It is 
hop^d that additional work aay be done to determine the optimum number of 
rates and their magnitude;^. 

Conclusion 

Two design efforts have been presented on aspects of the development 
of a practical highway vehicle for independent use by a severely disabled 
person. Neither of th^se can be considered as the final result as additional 
refinements are needed. 

While an operational prototype of the two bar lift exists and has shown 
its functional usefulness, additional design work will allow increased func- 
tion and improved mechanical integrity. 

Though the theoretical work above indicated that a discrete rate steering 
control would allow adequate driving performance, more detailed analytic 
techniques and real world driving tests are needed to truely validate this 
approach in vi*?"* of the difficulty in fully simulating the driving environ- 
ment in the laboratory. 

It is hoped that this work may be continued along with an integrated 
study of the total vehicle including areas such as driver restraint, 
control console design, and potential driver evaluation and training. 
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SumTnary . Tue use of the voice as a control signal for mobility 
aids to the quadriplegic has been the subject of much research. 
This paper describes the design, construction, and evaluation of 
a digital control system that responds to the variations In the 
pitch of a huinihed or whistled tone. This controller \as been 
attached to a standard electric wheelchair, providing a wide 
range of directional control. Films of the prototype control 
system in action will be shown. The system offers ^ atively 
wide control capability (7 or more discrete functiL.is) at lov 
cost. This project has been supported, in part, by the Veterans 
Administration. Two controllers are now being e^'aluated by 
the VA. 



Introduction 

The selection of control signals available 
from the quadriplegic with a high-degree of dis- 
ability is quite limited. Eve, ear, and tongue 
switches have been used, as will as breath control 
(puff and suck, etc.) The most obvious choice 
is the voice, however, but the myriad difficulties 
Inherent in voice i;ecognition have severely 
limited the use of spoken commands for mobility 
aids. 

As a compromise, one of the authors developed 
a prototype wheelchair control system^ that 
responded to the pitch of a hummed tone, rather 
than to words or syllables. This original control- 
ler demonstrated the feasibility of a pitch- 
controlled system. This paper describes the 
further development of the original pitch-control 
concept,. and the subsequent design of a digital 
pitch-sensitive cor^ ^roller. 

The Digital Controller 

The new digital controller was. designed with 
several goals in mind. Among these were social 
acce,. -ability (implying unobtrusive hardware 
and control action), responsiveness, eace of 
adjustment to various uses, relatively wide 
control capability, repeatability, and, hopefully. 



low cost (about $200), We feel that most of these 
goals have been realized in the control system as 
it now stands, 

A block diagram of the digital controller is 
shown in Figure 1, Vocal input to the controller 
is derived from a small clip-on throat micro- 
phone. This eliminates almost all extraneous 
noises. The signal from this microphone is 
amplified and filtered by a simple three-stage 
amplifier and then sent to a Schmitt trigger 
for '^squaring" prior to imput to the digital 
portion of the controller. 

The digital logic operates in a four-state 
sequence designated as COUNT, COMPARE, STORE, and 
RESET, During the COUNT period the zero-crossings 
present in the hummed input signal are accumulated 
,in a decade counter. The length of the COUNT 
period is controlled by a reference oscillator which 
is adjustable Co fit the comfortable frequency 
range of the user. Control frequencies from 50 to 
450 Hz can be recognized. 

At ^he end of the COUNT period the contents of 
the decade counter are compared with the counted 
value that was accumulated during the previous 
count period. The previous value is stored in a 
set of registers for this purpose. The comparison 
is used to differentiate between hummed control 
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Figure' 1: Block Diagram of the Digital System 
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signals and other sounds (talking, coughing, etc.). 
The digital control logic requires that the counted 
value, i.e., the hummed frequency, compare within 
a relatively narrow margin for three consecutive 
COUNT periods prior to initiating any control action. 
Thus, since speech and other sounds produce widely 
different counts during consecutive intervals, the 
controller responds only when the operator produces 
a hummed signal. 

The COUNT interval is nominally 0.27 seconds. 
Thti.s, the operator must maintain a relatively stable 
pitch for about 0.8 seconds (three COUNT periods) 
In order to initiate movement. Once started, however 
the controller remains energized until the operator 
stops humming, .illowing him to shift from one 
control signal to another with only a 0.27 second 
delay. 

At the end of the COMPARE period the current 
counted value is transferred into the storage 
register for use 'uring the next comparison. Then 
the RESET period allows the deca^'e counters to be 
cleared, after which the COUNT operation begins 
again. 

The various control signals are derived by 
decoding the high-order digit as it is stored in 
the register following each COMPARE period. In 
the case olc the wheelchair controller, seven 
different signals are decoded, corresponding to the 
high-order digits from 3 to 9. These control bands 
correspond to signals that produce from 30 to 39 
counts during the COUNT period, 40 to 49 counts, 
and so on. The width of these ''bands" allows the 
operator some latitude in each control frequency. 
The typical bandwith of a control band is about 
35 Hz. 

The control bands of the wheel chair controller 
are arranged as shown in Figure 2. The center band 
(50-59), when detected, energizes both wheelchair 
motors in the forward direction. The next higher 
and lower bands cause one of the motors to be cut 
off, thereby producing a veering to the left or 
right. The next two higher and lower bands cause 
the "off" motor to go into reverse, thereby 
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Figure 2: The Ov^irlapped Control Bands 



producing a left 04. right spin or rotation. 
Following an unused guard band, the highest control 
band initiates a reverse movement. 

The overlapping of these bands allows the 
operator to raake dynamic course corrections by 
shifting his pitch slightly upward or downward 
from the center (FORWARD) frequency. 

Visual feedback is provided to the operator 
by a frequency meter that is marlted in accordance 
with Figure 2* function lights indicating 
FORWARD, LEFT, RIGHT, and REVERSE are. also provided. 
With a little practice, however, most operators 
are able to relate frequencies and movement with- 
out needing visual feedback. 

As the controller is now designed, movement 
continues only as long as the operator continues 
to hum* Whenever humming ceases, a detection 
circuit disables the chair's motors within 0.02 
seconds and the chair coasts lo a stop. This serves 
as a fail - safe feature, stopping the chair when- 
ever the hummed input stops, as it would if thi; 
microphone slips out of place. 

Conclusions 

The controller described above seems to 
satisfy most of the original design goals. Its 
components cost approximately $200. It is not 
without problems and possible improvements, 
however. The necessity to maintain humming at 
all' times is an inconvenience, although quite 
desirable for safety, and some type of fall - safe 
method to allow the operator to continue motion 
without continuing humming seems desirable. Also, 
braking (mechanical or electrical) seems desirable 
for stopping and for holding the chair in place 
when stopped on an incline. 

Two controllers have been sent to the Veterans 
Administration Prothetics Center in New York for 
evaluation. It is expected that this evaluation 
will point to further need for improvement in the 
controller. 
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A RECLINING WHEELCHAIR THAT PROVIDES 
WEIGHT SHIFTING MOBILITY FOR THE QUADRIPLEGIC 

by 

Donald E. Rugg 
Charles E. Eppinger 



Background 

Damage ^:o the human spinal cord pro- 
duces disability which is somewhat predict- 
able in extent — the effects correlating 
fairly closely .o the vertical location of 
the injury. Within this general truism, 
however, the precise degree of paralysis is 
found to vary from individual to individual. 
These differences must be recognized as 
having extreme importance to the person 
living with them. Therefore, although a 
general class of equipment (such as wheel- 
chairs) is needed by nearly everyone with 
high spinal cord injuries, variations in 
the physical abilities of each must be 
carefully accommodated, in order to suc- 
cessfully fill the specific needs of each. 

Experience has taught that in rehabil- 
itation, real and usable solutions are most 
reliably achieved when real and individual 
problems are confronted; that is, a solu- 
tion which may entail the development of 
new hardware or modifications to existing 
items, will probably produce true success 
if the efforts are directed only at the 
major problem of a single disabled indivi- 
dual. Fortuno.tely , many times it is found 
that, following success on the original 
problem, a moderate amount of additional 
work will tailor the solution for use by a 
number of others. However, when the ini- 
tial thrust is made against a general prob- 
lem (or a nonproblem imagined to be 
possessed by a class of people) , it should 
be no surprise when the results are less 
than satisfactory, and the bill exorbitant. 

The Independence reclining notorized 
wheelchair, as described in this paper, was 
developed to answer the needs of a single 
quadriplegic: author Donald Rugg. The 
purpose of the paper is to relate its deve- 
lopment--from the position of the severely 
disabled person requiring it. To help un- 
derstand the motivation for the development 
of this wheelchair, a brief discussion of 
his physical disability and overall needs 
will be presented. 

Permanent paralysis resulted from spi- 
nal cord lesion at the C-4 and C-5 levels; 
the biceps, anterior deltoids, and middle 
deltoids remained functional , providing a 
reasonable range of arm motion. Although 
no wrist or hand motion remained, the 



problem of grasping objects was solved 
through appliances fitted to the forearm 
and hand. At this point, mobility was pro- 
vided by a traditional electric wheelchair. 

The Weight Shift Problem 

Within four years following the injury, 
most of the general problems faced by quad- 
riplegics had been solved. However, the 
ordinary electric wheelchair proved unsat- 
isfactory, due to lack of physical ability 
to shift weight while in a sitting position; 
this obviously imposed serious limitations 
on activities. In addition, the prolonged 
periods of sitting had resulted in repeated 
pressure sores, requiring surgery five 
times during this four year period. They 
could be prevented by being lifted from the 
wheelchair every three or four hours and 
placed in a supine position, in order to 
redistribute the pressure. But, this ne- 
cessity made full time employment impossi- 
ble; it also complicated daily home care. 
It became obvious that this problem — the 
prevention of pressure sores which would 
almost certainly develop from overlong sit- 
ting — was the limiting factor; with its 
solution a satisfying, productive life and 
a high level of independence seemed achiev- 
able. It was clear that in this case, the 
positive prevention of pressure sores could 
be accomplished without the need for an at- 
tendant, only if a means were available for 
shifting body weight while in a wheelchair. 

Past experience had shown that the 
preissure relief afforded by reclining peri- 
odically would successfully prevent pres- 
sure sores, while the use of various special 
cushions, including an alternating air 
cushion, had failed. Therefore, the con- 
cept of a pc 'ered wheelchair which would 
provide for lull reclining Coi perhaps more 
accurately a powered reclining mechanism on 
wheels) would allow occupying of th wheel- 
chair all day without the need for n 
attendant. 

Desired Functions 

The size and maneuverability of a stan- 
dard electric wheelchair were to be main- 
tained. But it was obvious that it would 
not be feasible to simply add a reclining 
mechanism to a standard "»lectric wheelchair; 
a fresh start was going to be required. 
With this decision made, a listing of the 
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desired functional characteristics could 
be begun. Since the needed device was in- 
tended for use by only one individual, 
these characteristics could readily be de- 
fined, in the necessary detail. Adequate 
mobility, indoors and out, and the avail- 
ability of enough energy to ensure all-day 
operation, were required. Speed capabili- 
ties to acconunodate both close quarters 
and long straight runs, and high maneuver- 
ability were also musts. The chair would 
bj required to negotiate, among other ob- 
stacles, a 30-inch doorway and ail ramps 
commonly encountered. In addition to pro- 
viding for full or partial reclining, 
convenient, once-a-day transfer was desir- 
able. All of these would have to be 
achieved with a device that would be 
sturdy, reliable, easily cleaned, and 
pleasant in appearance- Finally, all de- 
sired functions must be capable of control, 
utilizing the remaining body functions. 

Design Decisions 

In translating the desired functional 
characteristics into a mechanical design, 
it is convenient to consider the device to 



be composed of a reclining chair mechanism 
mounted upon a lower framework having 
wheels and drive motors. The geometrical 
limitations imposed by the parts of the re- 
clining mechanism, the rather massive 
storage batteries, and the drive motors, 
were found to be tiqht indeed. Since the 
chair was not. ever to be hand-propelled by 
its occupant, the drive wheels chosen were 
of 10-inch diameter. They wer^^i located at 
the front of the chair with casters at the 
rear, because the clearance circle required 
for caster swivelling could not conceivably 
clear the occupant's legs without thrusting 
the whole of the lower reclining frame much 
too far rearward. The independent powering 
of each of the front drive motors allowed 
for steering, through a provision for ener- 
gizing the motors separately or together, 
in either direction- For tidiness and easy 
cleaning, all possible frame members were 
fabricated from steel tubing which would 
later be chromium plated* 

he seat and footrest elements were 
dimens oned in an attempt to satisfy the 
proper upright position of the occupant, a 
height that would accommodate work at a 




standard desk, and adequate floor clearance. 
The seat depth was chosen to provide sup- 
port for the upper leg along a maximum 
lengthy in order to prevent the leg from 
slipping off the side of the chair; the 
seat width was chosen to fit the body 
fairly snugly, in order to assure correct 
side-to-side positioning. Seat cushions 
were of vinyl covered rubber foam, slightly 
concave, so as to present greater surface 
area for weight distribution. For this 
occupant, the back height was kept low so 
as not to further impede the limited shoul- 
der motion retained. 

Design of the reclining mechanism, 
wh."ch was after all the chair's reason for 
being, received particular attention. A 
fully horizontal position was desired, and 
yet the position of the center of gravity 
relative to the chair base had to assure 
that the chair would not tip over--at every 
degree of recline. In order to assume the 
horizontal position, it was necessary to 
raise the footrest, to lower the back, and 
to bring a headrest into position for head 
support since it was undesirable for the 
seat back to be that high. With the degree 
of disability involved, it was essential 
that the chair return the occupant to his 
original position on the seat, no matter 
how many cycles were gone through, 

A motor-driven lead screw provided mo- 
tion for the chair back, footrest, seat, 
and headrest through a mf ohanical linkage 
arrangement. A spring in the mechanism' 
which raises the heaarest furnished a 
counter force to assist the lead screw in 
returning the chair to its upright position. 
A close following of the occupant's motions 
by the chair elements, in order to assure 
repetition of his original position as men- 
tioiied above, was furnished by providing 
the seat with a fore and aft motion, tied 
to the reclining position. Therefore, as 
the back moves downward and the footrest 
and headrest begin to change their positions, 
the seat also slides rearwrrd slightly. It 
thus lengthens the distance from footrest 
to seat, and shortens the distance from seat 
to back. Thiii motion is vital to the 
chair's success because it allows the occu- 
pant to be returned to his original position, 
time after time, without assistance. 

Since the initial wheelcnair was de- 
signed for a quadriplegic with a reasonable 
range of arm motion, simple and functional 
controls were selected. A joystick, which 
allows for eight sectors of directional con- 
trol, directed power to the two drive 
motors, and provided steering. Slightly 
behind the joystick,^ a three-position switch 
was provided for selecting high or low motor 
speed, or power off. A third switch at the 



same location controlled the reclining oper- 
ation. These hand-operated controls were 
selected because of their simplicity, re- 
liability, low cost, and minimum interfer- 
ence with other body functions — and in 
preference to the several more sophisticated 
approaches which might have been used. All 
switching functions were accomplished with 
ordinary relay circuits. 

Concluding Remarks 

The original objective has been accom- 
plished; the chair has supplied mobility 
without the recurrence of pressure sores, 
through the weight shifting provided by re- 
clining. *rhe user remains in the chair 
about sixteen hours each day and has been 
employed on a full time basis now for over 
twelve years. The home care by others, 
formerly required, has been greatly reduced. 

This instance of pressure sore preven- 
tion is not unique. Many, if not most, 
high level quadriplegics who do not retain 
the physical ability to shift their weight, 
while sitting in a wheelchair, suffer from 
that problem. The benefits provided by 
the first Independence wheelchair were, 
quite naturally, sought for other indivi- 
duals in similar circumstances. At this 
date/ through a licensing agreement with 
the Falcon Research and Development Com- 
pany of Denver / nearly a hundred users 
have achieved similar self-sufficiency — 
have been able to continue their education 
or return to work on a full time basis, 
and greatly reduce the amount of home care 
required. 

However, each user is an individual 
case and requires individual consideration. 
First of all, the seat, back, footrest, 
and arm. ?st dimensions are tailored to che 
individual's physical size and weight. The 
means required to control the wheelchair 
are even more sensitive to i,he individual 
and his own degree of disability. With a 
reasonable amount of arm motion, a joy- 
stick control box as previously described 
can be utilized — mounted e;.ther upon one 
of the armrests or, in some cases, in a 
specit*i location immediately in front of 
the occupant. When insufficient arm mo- 
tion remains, good head motion is usually 
available. This has been exploited 
through the use of a chin control unit 
which is mounted immediately in front of, 
and slightly below, the user's chin. As 
before, this choice is based upon maximum 
simplicity and reliability, and noninter- 
ference with other necessary motions and 
functions^ it is preferred to other,. non- 
mechanic al' signals' for these- reasons* . It 
is out of the line of vision, and av/ay from 
the mouth. When the user vnshes to move 
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away from the unit slightly, he merely re- 
clines the back an inch or two. In all 
cases with the chin control, and in some 
cases with the hand-operated joystick, the 
on-off, high-low speed, and recline func- 
tions are available through three neck 
switches located around the user's collar, 
?.nd activated with the chin by nodding the 
head. 

Some electric wheelchair controls pro- 
vide for speed variation as a function of 
joystick position (proportional control) - 
However, most of the candidates for the In- 
dependence wheelchair do not possess suffi- 
cient hand and arm dexterity to successfully 
manipulate this type of control. It would 
merely add complexity and cost without 



solving a major problem, and has therefore 
not been used. 



The Independence wheelchair has solved 
the major problem of a large number of se- 
verely handicapped persons throughout the 
country, because it was designed through 
the observance of (1) careful identifica- 
tion of a specific problem before reaching 
for solutions, (2) a bias toward simple and 
reliable measures in preference to those of 
higher sophistication whenever possible, 
and (3) the application of combinations of 
tailored dimensions and special purpose 
accessories to one basic or standard item, 
which allows it to be furnished with 
reasonable economics. 
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A SURVEY OF ELECTRIC WHEELCHAIR POWER SUPPLIES* 



John Molnar 



Abstract , The severely handicapped are dependent upon electric wheel- 
chairs for mobility. Many of the handicapped are young quadruplegics. 
Whether or not these people can achieve any degree of self-sufficiency 
depends upon their ability to get about. 

Electric wheelchairs are being examined for possible improvements 
through recent engineering advances. The electric wheelchair can be 
divided into convenient subassemblies for study. One of the subassem- 
blies is the power supply. A detailed presentation of power supplies 
is made. The universally used lead-acid battery is compared to fuel 
cells, alkaline batteries, and new high energy density batteries. It 
is shown that for the present it is necessary to continue to use the 
lead-acid battery. Techniques to achieve maximum utilization and life- 
time for a lead-acid battery are descrlbeu. 



*This research was conducted at The Ohio State University, Columbus, Ohio, 
with the support of The National Science Foundation, under Grant No. GK-25292. 
**Mr. Molnar is with the Department of Electrical Engineering, The Ohio 
State University, Columbus, Ohio. 
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Introduction 



The nation contains a growing number of severely handicapped 
citizens, A large percentage of them are young adulv.s. The veterans 
who are quadruplegics due to war wounds have recently received national 
publicity [1]. Less publicized is the steady incrtiase in the number of 
quadruplegics due to diving and other sports-rela :ed accidents. The 
modem road systems and high perfoirmance automobiles hnve combined to 
produce increasingly destructive automobile accidents. The survivors 
of high-speed accidents are often partly or completely paralyzed, A 
few years ago, quadruplegics had a short life expectancy due to high 
vulnerabil*'* ty to urinary infection and decubitus ulcers [2]* Modern 
antibiotics and patient care have solved these problems, and the patients 
can expect .lOrmal life spans. The group is not limited to spinal-cord 
injuries c People with revere cases of cerebral palsy are also included. 
The patients want to become self-supporting, but lack mobility. The 
electric wheelchair is the key to helping the severely handicapped 
achieve independence. 

The adaptation of the response of the whep^lchali to the desires 
of the user is a direct function of the amount of money the user is 
willing to invest in his chair. The available wheelchairs can be cate- 
gorized into two groups: indoor wheelchairs and outdoor wheelcliairs , 
The former tend to be standard folding wheelchairs that have been fitted 
with drive motors, battery, and a control unit, usu£\lly of the "joystick" 
type. The latter tend to be motorized tricycles or golf carts and are 
generally too large and heavy to facilitate indoor usage. The indoor 
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chairs are portable, but require the removal of a 50-pound battery 
before folding. The typical indoor electric wlieelcliair v^ighs approx- 
imately 150 pounds with battery. 

The wheelchair can be conveniently divided into subassemblies. 
The subassemblies are: the power unit, the power supply (the suspension), 
the control unit, and the overall chair configuration. Each of the 
subassemblies is being examined for improvement. 

This paper is concerned with the power supply. The need for a 
portable power supply is felt in many areas^ including prosthetics. 
Lead-acid storage batteries are used to power electric wheelchairs. 
The lead-acid storage battery as a power source is heavy and requires 
nightly recharging; however, it is mass-produced which makes it inex- 
pensive and readily available. In the following paragraphs the lead-acid 
battery is compared to alkaline batteries, high energy density batteries, 
and fuel cells. Detailed lead-acid battery data is presented to acquaint 
the reader with the variety available. Finally, information is presented 
on how to attain the bast service from a lead-acid battery. 

The capacity of a s::orage cell may be expressed in two ways: as 
the amp-hour (Ahr) or the watt-hour (Whr) capacity [3]. Battery Ahr and 
Whr ratings are relative quantities. Th-B actual capacity of any given 
battery is greatly affected by the manner in which the battery is used. 
The discharge rate, temperature, and final voltage all affect battery 
performance. A battery that is rated to give a current for eight hours 
at the normal discharge rate will only function for about one hour at 
four times the normal discharge rate. Likewise, the battery will give 

one-fourth the current for about 56 hours [4]. 
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Another comparative number that is cited is the energy density. 
The energy density is coTP.puted by dividing the battery Whr rating by 
the battery weight. The energy density is an indication of battery 
efficiency in terms of the amount of material required to store elec- 
trical energy. High energy density batteries are desired. 

Alkaline Batteries 

The first energy storage devices to be examined can be collec- 
tively referred to as Alkaline Batteries. Included are batteries using 
Nickel-Cadmium, Iron-Cadmium, Silver-Cadmium, Silver-Zinc, and Manganese- 
Zinc for electrode materials. The batterie? are commercially available 
and manufactured in sealed and cell form. The Nickel-Cadmium (Ni-Cd) 
and Iron-Cadmium (Fe-Cd) batteries are examined here for possible use 
in powered wheelchairs [5]. 

The primary advantages of Ni-Fe and Ni-Cd batteries are their 
ruggedness and long life. A comparison of lifetimes is presented in 
Table 1. The life of a Ni-Cd battery is usually given either as the 
number of charge and discharge cycles ti^at can be delivered by the 
battery, or as the total lifet ime , It is difficult to give definite 
figures, since battery life will vary a great deal with different 
operating conditions. The Ni-Fe battery has a history of delivering 
one of the longest periods of useful capacity of any battery system. 
Vibration does not cause loss of active material from the plates. 
Neither Ni-Cd nor Ni-Fe batteries are damaged by overcharging, short- 
circuiting, or reverse charging. Ni-Fe batteries have been reported 
to last from seven years (in heavy duty service) to more than 25 years 
(in stand-by and floating' applications). 
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Typical energy densities and weights for Nr-Fe batteries are 
presented in Table 2, and for Ni-Cd batteries in Table 3, The energy 
density of Ni-Cd sintered plate and Ni-Fe batteries is comparable to 
lead-acid batteries. The energy density of Ni-Cd pocket [late batteries 
is less than for lead-acid batteries. Powered wheelchair manufacturers 
recoiranend 100 Alir capacity weighs 63 pounds and has an energy density 
of' 19.4 Wh/lb. Typical alkaline battery dimensions are listed in 
Table .4. Two lead-acid batteries have been included for comparison. It 
is seen that alkaline batteries tend to be larger than comparable lead- 
acid batteries. 

Alkaline batteries cost more than lead-acid batteries. Nickel 
and Cadmium are very expensive materials. A 12-volt, 100 Ahr Ni-Cd 
battery would cost approximately one- thousand dollars [6]. A comparable 
lead-acid battery would cost approximately sixty-five dollars. 

In order to obtain long life from alkaline batteries, careful 
servicing is required. The batteries must be periodically flushed. 
The user liere encounters an unexpected hazard. Alkaline batteries are 
not in wide usage. The person doing the battery maintenance may well 
add sulf uric-acid-based electrolyte. The sulfuric acid will ruin the 
battery. 

Thus it is seen that while alkaline batteries last longer than 
lead-acid batteries, the increased lifetime is outweighed by greater 
weight, higher cost, and lower energy density for alkaline batteries. 
Alkaline batteries are neither readily available nor servicable, and 
therefore are not recommended for use with P9v;ered wheelchairs. 
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TABLE 1 



COMPARISON OF BATTERY LIFETIMES 



Battery 



Number of Deep Discharge 
Cycles (>70% discharge) 



Total 

Lifetime in 
Years 



Ni-Fe 



2000 - AOOO 



7 - 25 



Ni-Cd 
(Pocket) 



500 - > 2000 



8 - 25 



Ni-Cd 
(Sintered) 



300 - >2000 



3 - 10 



Pb-Acid 



200 - 700 



3-6 



TABLE 2 



SELECTED ENERGY DENSITIES FOR NICKEL-IRON BATTERIES 



Cell Type Capacity per Weight per 
Plate Pair Plate Pair 



Ahr 



Lb 



Total Total Energy 

Battery Weight Density 

Capacity Lb Whr/lb 
Ahr 



A3 



37.5 



3.5 



112.5 105 



13.5 



C2 



56.25 



5.1 



112.5 102 



13.2 



D2 



75 



6.85 



150 



137 



13«2 



EB 



100 



7.45 



100 



74.! 



16.1 



EB2 



100 



7.45 200 

93 



149 



16.1 



TABLE 3 



TYPICAL VALUES FOR Ni-Cd SINTERED PLATE BATTERIES 

(SONOTONE) 



H High-Rate 
M Medium-Rate 
L,K A Low-Rate 



Cell Cell Capacity Cell Weight Total Battery Energy Den- 
Type Alir Lb. VJeight Lb. sity Ulir/lb. 



60L 420 

81H 120 

lOOM 220 

lOOM 320 

210L 420 

HIP- 10 

HIP- 14 

HIP- 15 

HI- 10 

HI-14 
I 

MDP-10 

MDP-13 

MDP-14 

MT)-14 

KAP-10 

KAP-13 

KAP-18 

KA-12 



70 
80 

111 
121 
230 
100 
125 
150 
100 
125 
100 
130 
140 
140 
95 
125 
175 
120 



5.19 
6.6 
11 
11 

19.8 
19.4 
26.2 
3.17 
20.9 
26 

12.8 
16 

20.2 
20. 1 
10.6 
13.4 
16.9 
].3.4 



52 
66 

110 
110 
198 
194 
262 
317 
210 
260 
128 
160 
200 
200 
106 
134 
169 
134 



16.2 

16.7 

12.1 

13.2 

14.0 

6.2 

5.7 

5.7 

5.7 

5.7 

9.4 

9.75 

8.4 

8.4 

10.7 

11.3 

12.4 

10.7 
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TABLE h 



TYPICAL ALKALINE BATTERY DIMENSIONS 



Battery Type 



Lead-Acid 



Lead-Acid 



Nickel-Iron 



Nickel-Iron 



N i eke 1- C ad mi urn 



Battery 

Capacity 

Ahr 



102 



105 



75 



100 



80 



Nickel-Cadmium 111 



Nickel-Cadmium 100 



Nickel-Cadmium. 100 



Nickel-Cadmium 120 



Length 
13 9/16 
17 15/16 

24 3/4 
20 

27 1/2 
40 
30 
29 



Dimensions 
Width 

6 13/16 

7 1/8 
32 

26 

5 1/8 

6 3/4 
6 3/4 

5 3/8 

6 3/4 



Height 
9 13/16 
9 5/8 
29 
23 

8 1/2 
8 3/4 

15 1/2 
12 3/8 

16 1/8 



*Nickel-CadmiuTn batteries with sintered plates — other Nickel-Cadmium 
batteries listed have pocket plates. 
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High Energy Density Batteries 

High energy density batteries for use in electric automobiles 
are being developed [7]. The goal is production of a battery with a 
100 Whr per pound energy density at a cost of one dollar per pound. 
Two types of batteries are being developed. Both the Ford Motor Co, 
and the Dow Chemical Company have developed experimental sodium-sulfur 
(Na-S) batteries, A lithiura-sulf ur (Li-S) battery is undergoing tests 
at the Argonne K.?tional Laboratory, While both batteries avp. in the 
developmental stage, indications are that the energy density and cost 
goals are achievable. The work on the Na-S battery is more advanced 
than the Li-S battery. Also, the Na-S battery will require less money 
than the Li-S battery to set up demonstration hardware. The successful 
demonstration of a Na-S battery may well lead to stopping work on the 
Li-S battery. Both batteries are high temperature devices that operate 
at temperatures over 300°C, 

During the period nf July 1970 to June 1971, approximately fifty 
experimental Li-S cells of various designs were tested. Cycle lives of 
over 800 discharge-charge cycles have been demonstrated. Current and 
energy densities have been achieved that indicate that a battery consisting 
of Li-~S cells can meet the energy density goal. An energy density of 
150 \^r/lb has been predicted for a Li-S battery which is much greater 
than the 16 Whr/lb for a lead-acid battery [8], Except for the lithium, 
which is less than ten percent of the cell by weight, the materials 
needed for a Li-S cell are plentiful and inexpensive. The potential 
cost of a mass-produced cell would appear to meet the design goal, 
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Ford Motor Company has developed a Na-S cell that has a molten- 
sodium anode, a crystallite ceramic electrolyte, and a melt of sodium 
sulfide and sulfur for the catholyte. The Ford cell uses a ceramic 
membrane made of beta-alumina. The theoretical energy capacity of a 
sodiuTO-suif ur battery is 360 Whr/lb while the estimated practical 
energy density is 100-150 Whr/lb. 

Work is progressing to develop high energy density batteries 
that operate at room temperatures. The results thus far are en- 
couraging and indicate the possibility of high energy batteries that 
would be operable at room temperature, although maximum power might 
occur at a higher operating temperature. 

Practicaj. lithium-sulfur and sodium-sulfur batteries can be 
expected to be developed before low-temperature batteries. The high 
energy density batteries that are being designed f(;r the automotive 
market should be applicable to powered wheelchairs. The commercial 
appearance of tne high energy batteries described above is some time 
away. The batteries are predicted to become available during the 
early 1980 's [9]. 

Fuel Cell s 

The fuel cell merits consideration for use with powered wheel- 
chairs. Most of the engineering work for developing fuel -cell power 
systems has been done in the past ten years [10]. The elimination of 
long recharging periods makes the fuel cell attractive for use with 
powered wheelchairs. The same feature makes comparison with conventional 
batteries difficult [11]. Batteries are compared by means of their 
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energy densities as given in Whr per pound. Such an energy density 
figure of merit does not apply to fuel cells. A fuel cell consists of 
two parts: the reaction apparatus and the fuel supply. Electricity 
is produced as long as fuel is supplied. Thus, the energy capacity 
rating is open-ended « 

The only successful fuel cell to date is the hydrogen-oxygen 
cell. Hydrogen Is the fuel , oxygen is the oxidant , and potassium- 
hydroxide is the electrolyte. The hydrogen and oxygen react to produce 
the byproducts of electric current and water. The production of water 
has been useful to the space program, where hydrogen-oxygen fuel cells 
have been used extensively. 

As larger current is drawn from a fuel cell, the terminal poten- 
tial will drop. The loss of potential is known as polarization. To 
minimize the effects of polarization, platinum, palladium, and silver 
have been used for the electrodes. The result is very expensive cells 
that only the space agency has been able to economically justify. In 
1968 a commercially available cell was announced by Yuasa Battery Company 
in Japan [12]. The price quoted at the time was $2775. The cost alone 
disqualifies the hydrogen-oxygen fuel cell from consideration for use 
with powered wheelchairs. Another bad feature of the hydrogen-oxygen 
fuel cell is the potential explosion hazard. Also, the hydrogen and 
oxygen are supplied and stored in liquid form, which is not practical 
for a wheelchair. Suppliers of liquid oxygen and hydrogen are not 
readily available. 

Much developmental work has been done on hydrocarbon fuel cells. 
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In a hydroiarbon fuel cellr a more convenient and less expensive fuel 
such as natural gas or propane, reacts with air to produce electricity 
[13]. Direct hydrocarbon fuel cells have not reached a useful stage of 
development, primarily due to slow rates of electro-chemical reaction 
for organic fuels. The best simple catalyst found so far is platinum. 
The most successful hydrocarbon fuel cells actually convert the fuel 
into hydrogen which is then used to produce electricity. When a 
re-former is used to generate hydrogen from a hydrocarbon fuel, the 
overall system efficiency falls. The re-forming process is only about 
50 to 70 percent efficient and introduces an increase in system hard- 
ware and complexity. 

In summary, fuel cells are expensive, because of costly fuel. 
Their lifetime and ease of maintenance for extended operation have not 
been proved. The future :)utlook for fuel cells does not look promising 
at this time [lA]. No one is willing to pay the cost of making fuel 
cells a practical reality. 

Lead- Ac id Bat teries 

From the preceding, it is seen that due to the lack of competitive 
alternatives, it will be necessary to continue to use lead~acid batteries 
in electric wheelchairs. The primary disadvantage of the lead-acid 
storage battery is the weight. The capacity of a storage battery is 
dependent upon the amount of material in the plates, the plate thickness, 
and the design of the plates. High capacity batteries require many large, 
heavy battery plates [15]. 
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Typical battery characteristics [16] are presented in Table 5. 
It is seen that both the battery weight and number of plates increase 
as the battery capacity increases. IVhile the physical battery size 
does not greatly increase with higher capacity, the weight and cost do. 
Comparing the 80 and 375 Ahr batteries, it is seen that for a 470% 
increase in capacity, the weight and cost increase by 634% and 566$, re- 
spectively. The \-Jhr capacity and energy density for each of the bat- 
teries in Table 5 are listed in Table 6.' It is recommended that the 
smallest capacity battery that would satisfy the individual requirements 
be used. The increase of running time does not justify the increased 
weight of a higher capacity battery unless such a battery is actually 
needed. The truely high capacity batteries would require extensive 
bracing of the wheelchair in addition to an initial battery cost out 
of proportion with the useful gain. 

The performance and reliability of powered wheelchairs can be 
improved through better education of the users. With proper care, a 
lead-acid automotive storage battery can last for two or three years. 
However, the users receive very little instruction on how to care for 
the battery. Only recently have some manufacturers started recommending 
battery capacities. Often users have purchased inadequate batteries due 
to financial restraint and lack of knowledge about power requirements. 
More detailed instructions, including a preventive maintenance schedule, 
should be furnished by manufacturers. Writing such instructions would 
be challenging, for the users often have a meager technical background. 
The procedures necessary to get the most ^^ficient usage from a battery 
are described next. 
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The powered wheelchair user needs to know how much energy remains 
in his battery* This is especially true if he operates the wheelchair 
out of doors. An amp-hour meter would give a visual indication of 
charge status. One type of amp-hour meter that could be used on powered 
wheelchairs is basically a mercury microcoulometer . The microcoulometer 
is a glass capillary tubing filled with two columns of mercury separated 
by a small electrolyte gap. Application of ^ direct current to elec- 
trodes Inserted in the mercury causes mercury at the anode to be 
electrochemically transferred across the gap to the cathode at a time 
rate proportional to the current. The gap moves along the tube length 
which can be calibrated to indicate the amount of battery charge re- 
maining, A typical tube- type amp-hour meter would measure 1,87 x 0,37 
X 0,39 inches with a one-inch scale, weigh eight grams, and cost approx- 
imately ten dollars [17], 

The maximum capacity of a lead-acid battery is obtainable only 
through complete charging. Complete charging can be obtained only by 
knj^^ledgeable use of carefully selected equipment. Powered wheelchair 
users must be educated in the why and how of battery charging. An ideal 
charging cycle consists of a high initial surge of charging current, 
followed by a steady charging current ^ and finished with a charging 
current that is slowly reduced [18], 

Many battery chargers are available coirmercially • One retailer 
has a selection with prices varying over a range of nine to thirty-five 
dollars. As the price increasj...? , raore features are added. It is re- 
comtuended that the powered wheelchair user not stint on purchasing a 
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battery charger. The high priced model mentioned above initially 
delivers a short 50 amp booster charge. The charger then switches to 
nornial 10 amp charging rate which is tapered to five amps towards the 
end of the chargin^^ cycle. All switching and turn off are automatically 
controlled. Less expensive chargers deliver smaller charging currents, 
which means longer charging times are required. The low cost chargers 
must be monitored and manually shut down to prevent excessive battery 
gassing • 

Once a week the battery should be given an overcharge, known as 
an "equalizing charge." The purpose of the equalizing charge is to 
bring all the cells in the battery to the same level of charge. The 
equalizing charge is accomplished by continuing to charge the battery 
at a low rate with the cells gassing freely ur.til three consecutive 
readings of the specific gravity and voltage show no increase. If the 
wheelchair user is unable to check the specific gravity, he should make 
arrangements for an attendant to do so. It may be necessary to rewire 
the battery charger to permit overcharging. 

Once every three or four months, the voltage and specific gravity 
readings of each cell should be recorded. Trouble such as sulphation 
or leakage is indicated by a progressive change in specific gravity 
readings. The specific gravity of the cells must be adjusted whenever 
electrolyte has been added to the cell. Specific gravity adjustment 
should be done at the end of the equalizing charge. The specific gravity 
should need adjusting only if the electroly-te has been spilled. The 
electrolyte level should be monitored. Excessive gassing during charge 

will remove water from the electrolyte leaving a more concentrated 
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solution of sulfuric acid* Should the level be low, water should be 
added. The water should be added before charging to permit mixing 
with the electrolyte during charge. 

The battery connections must be kept tight at all times. The 
battery terminal posts should be given a light coating of petroleum 
jelly to prevent corrosion. A battery case is recommended to protect 
the battery from the elements, should the wheelchair ' be used out of doors. 
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TABLE 5 



TYPICAL 12-VOLT LEAT- '.CID BATTERY RATINGS 



Ahr Weight. Number Cost Dimensions (In.) Design Use 

Lbs. of Dollars Leng'rh Width Height 

Plates 



80 48 78 46.45 12 7/16 6 5/8 8 15/16 Automotive 

95 53 90 51.95 12 7/16 6 5/8 8 15/16 Automotive 

95 69 66 70.45 11 7/8 6 7/8 10 15/16 Tractor 

100 70 138 91.95 10 29/32 10 3/16 9 1/16 Ordnance 

102 63 90 63„95 13 9/16 6 13/16 9 3/16 Commercial 

105 77 78 77.95 17 15/16 7 1/8 9 3/8 Heavy nuty(Truck) 

135 99 90 81.95 16 1/2 7 1/16 11 Tractor 

155 122 114 109.45 20 3/8 8 11/16 9 3/4 Heavy Duty 

174 141 138 115.45 20 3/8 9 13/16 9 3/4 Hsavy Duty 

204 154 150 129.45 20 3/8 10 15/16 9 3/4 Heavy Duty 

275 212 162 183.45 20 3/8 10 7/8 11 7/16 Mine Car 

375 304 114 247.45 20 1/4 10 7/8 14 7/8 Mine Car 
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TABLE 6 

ENERGY DENSITY FOR TYPICAL LEAD-ACID BATTERIES 



Ahr i-Jhr Weight Energy Density 

Lbs. UTir/lb. 



80 960 20.0 



95 HAG 53 21.5 



95 llAO 69 16.5 



100 1200 70 17.2 



102 1225 63 19.4 



105 1260 77 16. A 



135 1620 99 16. A 



155 1860 122 15.2 



174 2090 141 14.8 



204 2440 154 15.2 



275 3300 212 15.5 



375 4500 304 14.8 
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Conclusions 



Various energy sources have been examined. It has been seen 
that technology is not far enough advanced to permit use of fuel 
cells or high energy density lithium-sulphur batteries. Alkaline 
batteries are seen to have lower energy densities and higher costs 
than lead-acid batteries. It Is not felt that the longer life justi- 
fies the out-of-proportion cost increases. Thus, probably for the next 
decade, it will be necessary to continue to use lead-acid storage 
batteries, with their disadvantages of high weight, frequent charging, 
and required maintanance. 

It is felt that powered wheelchair users should be better trained 
with respect to battery care. Charging procedures and general battery 
maintenance have been described. , 
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A VOICE-CONTROLLED TELEPHONE FOR THE MOTION HAtmiCAPPED 

by 

F. E. Froehlich 
and 

P. J. Keaveney 
Bell Telephone Laboratories 
Holmdel, New Jersey 

and 



G. M. Smith 
American Telephone and Telegraph Company 
New York, New York 

Sumnary . This paper describes an experimental voice- 
controlled telephone developed at Bell Telephone Lab- 
oratories and discusses preliminary results of a small, 
informal field experiment. 



Introduction 

To make it possible for people to use the tele- 
phone unassisted, despite loss of finger and arm 
function, an experimental, self-contained, com- 
pletely hands-free telephone was developed. All 
normal telephone functions are controlled by the 
user's voice. In addition, the unit performs reper- 
tory dialing functions and includes facilities for 
voice control of appliances such as a reading lamp 
or a television set. 

Telephones and the Disabled 

Background 

The telephone plays a most important part in 
rehabilitation medicine, according to Dr. Howard A. 
Rusk, one of the leaders in the field of rehabili- 
tation. He once remarked that even with the most 
skillful surgery, the most effective medication, the 
beit post-operative care, the finest physical and 
occupational therapy, and the most advanced orthotic 
and prosthetic devices, rehabilitation cannot be a 
success unless the patient's needs for communication 
are met. 

Because of restricted mobility, a disabled per- 
son has a greater need for telephone communication 
than the rest of us. If he can use a telephone, he 
can maintain contact with his friends, conduct a 
business or practice a profession, stmunon assistance 
in emergencies, and, in many cases, release another 
member of the household from full-time custodial 
duties. 

Bell Offerings for the Handicapped 

' For many years, the Bell System has offered 

telephone equipment to aid people with many catego- 
ries of disability, including heeu:*ing impairment and 
deafness, impaired vision and blindness, weak speech 
and totaJ. loss of voice. Many simple arrangements 
are available to make telephoning easier for people 
with minor motion handicaps, and numerous one-of-a- 
kind installations have been made on a specially 
engineered basis for individuals who are virtually 
immobile . 



Special engineering is time-consuming, however, 
and the higher cost of a special installation is 
often a burden to a handicapped individ.ual with 
limited financial resources. Thus there has been 
for some time a need for a simple, standard, inexpen- 
sive arrangement for controlling the telephone which 
is not dependent on motion of the fingers, toes, 
limbs, head or neck. 

Control Without Body Motion 

Breath Control 

One possibility which has been exploited with 
considerable success in Great Britain is breath con- 
trol. The British POSSUM (Patient Operated Selector 
Mechanism) provides not only control of the tele- 
phone but control of environmental variables and 
control of work operations such as typewriting. 
Control is accomplished by sucking and puffing on a 
small air tube in accordance with a prearranged code. 
A glowing layman's description of the POSSUM 
appeared not long ago as the feature article in a 
U.S. mass-circulation magazine (1). 

Voice Control 

Perhaps the most attractive approach is ^oice 
control. Certainly it is the designer's ultimate 
dream and the user*s hope, but the technical prob- 
lems are so formidable that a practical and econom- 
ical device based on speech recognition principles 
may not become a reality for many years. 

Meanwhile, Clifford J. Hoffman of Bell Tele- 
phone Laboratories has proposed a radical simplifi- 
cation of voice control techniques, in which 
recognition is by means of time-induced orthogonality 
(2). With the simplified technique, the user exer- 
cises control merely by synchronizing his vocal 
utterances with an active feedback, which may be 
either audible or visual. To put it another way, he 
generates control codes by dropping his words into 
specific time slots which are defined by a machine- 
to-man feedback. The recognition problem with time 
separation of speech utterances is so simple that 
in the most elementary control scheme only an energy 
-threshold detector is required. 
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From the user's point of view, this kind of 
voice control is obviously more awkward, more arti- 
ficial, and appreciably slower than control based 
on straightforward speech recognition. The 
advantages, however, are impressive. First, cost 
is reduced by several orders of magnitude, and so 
are space and complexity. Second, there is com- 
plete insensitivity to the speaker variations which 
are one of the major bugaboos of speech, recognition . 
Third, and piost convincing, voice control by time- 
induced orthogonality is feasible today,' with to- 
day's state of the art. 

t 

The Basic System 

Visual Feedback 

Time-induced orthogonality provides a form of . 
binary control in which, for each time slot, 
acoustic energy in excess of a preset energy thresh- 
old represents a "l" decision and a sub-threshold 
signal (or silence) represents a "O". In its 
simplest embodiment, the voice-control apparatus 
consists of suitable speech input equipment and a 
visual feedback display of ten digits arranged in a 
circle. Each digit has associated with it a light, 
and the lights are illuminated sequentially, each 
for a time T, as* shown in Figure 1. 



BINARY DECISION 
■0' OR '1' 




FIGURE 1. Binary control scheme. 

The numerals are lighted sequentially 
with period T. A number can be selec- 
ted by applying an above-threshold 
acoustic signal while it is illuminated. 
The feedback lamp in the center indicates 
successful selection. 

The displiay runs continuously and any desired 
digit may be selected during the interval when its 
associated light is on, i.e., during its time slot. 
Successful selection takes place if at any time 
during this interval T the acoustic input exceeds 
the threshold value. Success is indicated or fed 
back to the user in two ways, by a momentary flash 
of the feedback signal light at the center of the 
circular display and by a momentary pause in the 
apparent rotation^ of the display. 

Audio Feedback 

Another possibility is the use of audio feed- 
back rather than visual feedback. Instead of 



watching a series of lights being illuminated 
sequentially, the user listens to a series of 
spoken digits on a recording. He selects a specific 
digit by putting a voice signal into a chosen time 
slot, just as in the case of visual feedback, but 
successful selection is indicated by an audible sig- 
nal. This might be, for example, audible repetition 
of the digit selected. 

Audio feedback has two obvious advantages . 
First, the user's visual attention is not required^; 
his eyes are free for other tasks, such as looking 
at a number in the telephone directory while dialing 
it. He could also use such a dial if he were blind 
as well as motion handicapped. 

Second, it is conceivable that the equipment 
for audio feedback could be installed at the central 
office, which would reduce somewhat th<5 i^ost to the 
customer. Still further cost reduction might be 
accomplished by arranging for use of the equipment 
on a shared or common basis among a number of handi- 
capped customers. It is not likely, however, that 
concentrations of disabled individuals warranting 
shared equipment would occur very frequently outside 
of hospitals or rehabilitation centers. Thus equip- 
ment sharing would seem to have its principal 
application behind the PBX*s in such institutions. 

The major disadvantage of the audio feedback 
approach is that the recording with the spoken 
digits could not be allowed to operate continuously. 
In continuous operation it would have an annoying 
and distracting effect which the continuously- 
running visual feedback does not. This meEuis that 
some form of supplementary mechanical control, 
either a touch switch or breath switch or the like, 
is necessary to activate the feedback prior to dial- 
ing and to disconnect it after completion of dialing. 
Likewise, it would have to be activated prior to I 
entering any control code and deactivated immediately 
afterward . 

Control Codes 

For practical applications of a voice- 
controlled telephone , two kinds of inputs must be 
processed, control codes and telephone numbers. 
Control codes are of fixed length, but telephone 
numbers are not . They are random digit sequences 
varying in length from two digits for a dial inter- 
com or small dial PBX up to as many as twelve or 
fourteen digits. 

The straightforward way to deal with this prob- 
lem is to assign one control code for access to 
the dialing mode. Escape from this mode must be 
provided following the last digit of the telephone 
number, and the simplest escape route is via an 
eleventh position on the feedback d' r^Q-y. An 
above-threshold acoustic input in thj eleventh time 
slot signals the apparatus to discontinue processing 
variable-length telephone numbers aiid to resume 
responding only to f ixed-leng;th control codes . 

In addition to its control function, a control 
code guards the voice-control system against false 
operation by conversation or environmental noise, 
i.e., it minimizes what is commonly referred to as 
''talk-off". The longer the code, the greater the 
talk-off protection. 
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Experimental Units 

General 

A small n^omber of experimental voice-controlled 
telephones employing visual feedback principles have 
been i>uilt by Messrs. V. J, Biancomano and G. S. 
Solowaj* of Bell Telephone Laboratories and have 
been used in a limited and informal field experiment. 

For Jnaximum flexibility, these units generate 
dial pulses, rather than TOUCH-TONE signals, so 
they can be ' used in any locality. They are 
eq.uipped with a Jack for connection of an external 
control switch such as a touch or proximity switch, 
microswitch, foot switch, breath switch or any 
other suitable normally-open single-pole switch. 

Visual Feedback Display 

The circular display on the experimental units, 
as shown in Figure 2, has twelve positions, desig- 
nated "1" th' ough "0" and "S" and "d". Twelve 
positions ma^e a layout similar to a clock face, 
which was felt to be advantageous, and two time 
slots in addition to the ten for the digits were 
needed to accomplish all the desired control 
functions, "s" stands *'or "STORE" or "STOP", 
depending on context, and "D" stands for "DIAL". 
"dial" is used to obtain dial tone, preparatory to 
outpulsing. "store" is used to write a new number 
into the repertory, and "STOP" has several uses. 

A light-emitting diode (LEP) is associated with 
each of the twelve clock positions. The LED*s are 
illuminated one at a time in a continuously-running 
sequential display, but the 90° points on the 
"clock" face (corresponding to 3, 6, 9 and 12 
o'clock) are dimly lit at all times. This facil- 
itates operation in total darkness. LED's consume 
much less power than conventional incandescent 
lamps, are inexpensive, and have a service life 
which far exceeds the life of the equipment. 

Timin-t Considerations 

Human factors studies indicated that the rota- 
tional rate of the display should not be greater 
than about one revolution every six seconds, and it 
was assumed that most users would want considerably 
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slower speeds when first introduced to the equipment. 
A rotational rate control was provided, so that tlie 
display speed could be increased as the user 
became familiar with the dialing procedure. The 
optimum speed setting was viewed as that which 
y'.elded the best compromise between dialing speed 
and dialing error rate. 

Even at maximum rotational speed, interdigital 
dialing time would be six seconds when dialing 
double digits, whereas maximum allowable inter- 
digital dialing time in modern central offices can 
be as little as k.'^ seconds. For this reason, the 
number dialed is inserted in an electronic- store, 
after which it is released on command and outpulsed 
to the central office at a standard rate. 

Typically, a handicapped person can dial a 
random T-digit number, plus the necessary control 
codes, in 35 to seconds with this arrangement, 
and expend negligible effort in doing so. Con- 
sidering that he might not be able to dial manually 
at all , or that he could dial manually only very 
slowly and with extreme difficulty, the extra time 
involved does not appear to be a very serious pen- 
alty. After all, non-handicapped individuals fre- 
quently take as much as 15 to 20 seconds to dial 
a T-digit number with a rotary dial. 

The overall dialing process will be slower if 
the control code is longer, and talk-off protection 
will be less if the control code is shorter. IT-ius 
optimum length of the control code is a compromise 
between the desire for speedy and uncomplicated 
operation and | the need to minimize talk-off. For 
the experimental units, a three-digit code was 
selected as a reasonable compromise, and talk-off 
protection was enhanced by employing codes with a 
structure such as 2-5-8 rather than adjacent number 
codes such as 2-3-^. Because numbers at the 90°, 
l80° and 270° locations on the dial seemed easiest 
to remember, the 3-6-9 code was chosen for control- 
ling incoming and outgoing telephone calls and pro- 
viding access to the repertory store locations. 

Greater Utilization of Electronics 

The electron:}^ store, once having been provided 
for the n\amber being dialed, was available for other 
possible uses. It was arranged to function also as 
a last-number repertory, so that the complete dial- 
ing procedure would not have to be repeated to re- 
dial a number after encountering a busy signal. 

With the one store location already provided, 
it was a simple matter to add more locations. Four 
additional store locations were accordingly provided 
for conventional repertory dialing purposes , on the 
assumption that four repertory numbers would be 
adequate for most users. Numbers are inserted in 
the repertory by voice command, using control code 
"S" (for "STORE"), and can be changed at will. 

The logic circuitry for recognizing control 
codes was also put to other uses. In addition to 
the 3-6-9 code chosen for telephone control, two 
3-digit codes were assigned for controlling auxiliary 
apparatus . This wb.s done to provide an opportunity 
for evaluating the feasibility and utility of an 
auxiliary control function. By employing codes with 
the same structure as 3-6-9, e.g., 2-5-8 or 1-^-7, 
the same degree of talk-off protection was obtained. 

Other Features 

Because the user of an electronic device gen- 
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erally wants to know at a glance vhether it is on 
or off, an OW light was provided on the experimental 
voice-controlled telephone. The light is turned on 
by the 3-6-9 code whi'^h activates the system, and it 
stays on until this same code is used a second time 
to turn the system off. The rotating light display 
is unaffected; it operates continuously, vhether or 
not the ON light is lighted. 

In addition to its visual feedback function, 
the rotating light display also enables the user to 
monitor out pulsing and verify the number being 
dialed. As each digit is outpulsed, the LED*s are 
momentarily lighted in sequence at the outpulsing 
rate of 0.1 second per dial break, beginning with 
No. 1 for the first pulse. No. 2 for the second. 
No. 3 for the third, etc. For example, dialing 
a 5 causes LED*s 1 through 5 to be lighted momen- 
tarily and in sequence; dialing a 3 causes LED^s 1 
through 3 to be lighted momentarily and in sequence , 
and sc ^n^ 

While the voice-control system is powered by 
commercial a-c , a rechargeable battery has been 
provided to assure service continuity during power 
failures. The battery will give about three hours 
of emergency service. The cells are continuously 
on charge during normal operation, and recharge 
time from completely discharged to fully charged 
condition is about 28 hours. 

Allowance has been made for complete flexi- 
bility of telephone instruments. The experimental 
voice dialer is equipped with a jack into which a 
regular handset , a headset or a Speakerphone can be 
plugged. 

As the system was developed, the easiest num- 
ber to dial is "operator." This could be very help- 
ful under emergency conditions. 

Informal Field Experiment 

Aims 

It was apparent that the only reliable way to 
find out whether the experimental voice-controlled 
telephones would do what they were intended to do 
would be to let disabled people use them. This 
would provide operating experience, an opportunity 
to observe - and perhaps remedy on the spot - any 
conditions which were bothersome to the users, and 
a chance to obtain and assess user reactions. A 
very small and very informal field experiment with 
these objectives was accordingly undertaken. 

Trial Subjects \ 

The trial subjects were volunteers recommended 
by Dr. Richard A. Sullivan, Director of the Kessler 
Rehabilitation Institute from a roster of out- 
patients Emd former patients. Other subjects were 
volunteers recommended by Prof. Muriel Zimmerman 
of Rew York University's Institute of Rehabilitation 
Medicine or by Mr. A. Maurer of New Jersey Bell. 
The subjects included eleven males and six females, 
ranging in age from 12 to years. They had been 
disabled by traumatic quadriplegia, poliomyelitis, 
multiple sclerosis, muscular dystrophy, arthro- 
gryposis, and, in one instance, by an undetermined 
muscle disease. These individuals represented a 
vide range of dialing capabilities, from one person 
who could use a TOUCH-TOKE dial with relative ease , 
to those who coTild dial only with the greatest 
difficulty or not at all. 
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Trial Locations 

Trial installations were made in the following 
locations : 

Hospitals and convalescent centers 2 

Rehabilitation centers 2 

Offices 2 

Homes 11 

Installation Details 

The subjects took full advantage of the flexi- 
bility offered by the experimental equipment. Five 
used headsets, one, used a Speakerphone , and the rest 
used handsets heldf in a suitable position by some 
kind of adjustable arm. All subjects but one used 
voice control, the exception being a mail who used 
the Speakerphone with a pushbutton control. 

User Reactions 

A preliminary evaluation of the subjects' com- 
ments indicates that the voice-controlled telephone 
was veil regarded and was rated all the way from 
very convenient to almost indispensable. Neverthe- 
less, it was clear that to debug the system com- 
pletely would involve a small amount of additional 
development work. 

Preliminary findings are as follows: 

1. None of the users had trouble placing calls. 

2. Nearly all users, at one time or another, 
had been distracted while dialing and had 
had to stop and begin again at the 
beginning. 

3. Not everyone fully mastered the technique 
of re-using the last number called. Those 
who did master it reported liking this 
feature and using it frequently. 

h . Practically everyone used and liked the 
repertory feature. They were satisfied 
with the capacity of four numbers. Under- 
standably, thf number most frequently 
stored was "i<ll" (Directory Assistance). 

5. Use of the 3-6-9 code for answering in- 
coming calls was felt by most respondents 
to be acceptable but a bit unwieldy. 

6. All subjects had asked to have the speed 
of the rotating LED display adjusted. 
Several had it set at maximum and two 
preferred minimum. The rest were spread 
out between these extremes. 

7. All subjects, without exception, reported 
having been cut off by talk-off. Fre- 
quency of cutoff appeared to be correlated 
with display speed. 

8. Slurred speech or speech affected by the 
action of mechanical respirators caused 
dialing errors. 

9. The auxiliary controls were very highly 
regarded by everyone, even by those who 
were the least enthusiastic about or had 
the least need for voice dialing. 

10. The procedure for answering an incoming 
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call that has been picked up first on 
another extension was found to be incon- 
venient. (This situation can be easily 
remedied by minor circuit changes). 

11. As the equipment is presently wired, the 
user cannot immediately answer an incoming 
call if, when the bell starts ringing, he 
happens to be in the midst of dialing 

and storing a telephone number. He must 
first stop and void what has been stored 
before he can answer . 

12. Users who were accustomed to manual ser- 
vice or DOP (dial operator privilege) and 
liked it were nevertheless strongly in 
favor of the voice-operated dial. They 
reported that it gave them an added feel- 
ing of independence and a greater sense 
of privacy. 

13. Users reported that they had no objection 
to leaving the rotating light display on 
all night. Although a switch had been 
provided for turning the displeiy off at 
night, it was seldom used. 

lU. When used with an external control switch 
instead of voice control, talk-off was 



precluded and operation of the system 
closely approached the ideal. 

Conclusions 

A voice-controlled telephone along the lines of 
the experimental model described herein would fill 
a real need for many people with severe motion 
handicaps. For those able to use it, a unit with 
external switch control would be even more valuable. 

All the extra features provided were found to 
be sufficiently useful so that their inclusion in 
the experimental models was fully justified. The 
auxiliary control function was particularly well 
liked. 

Talk-off protection requires further study. 
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A SELF-TIIvnNG INDEX TONE GENKRATOR 

by 

T. V. Cranmer, Director 
Division of Services for the Blind 
Bureau of Rehabilitation Services 
Frankfort, Kentucky 



During the past year volunteers reading text books 
for the blind on tape cassettes have been testiiig a simple 
transistorized tone generator designed to record sub- 
sonic indicators on the tape simultaneous with the verbal 
announcement of each text book page number. Since vrolun- 
teers are used for this work, it was necessary to design 
a system of indexing that would require an absolute mini- 
mum of instruction. Other considerations were economy 




note: to eliminate a turn-off j 

TRANSIENT. ADD A 40mfd CAPACITOR 
BETWEEN CATHODE OF 3N84 AND 
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FIGURE 2 . Form of the self-timing 
page marker. 



and ruggedness of construction* Thirty of these units 
have been in use during this year with excellent results. 

Figure 1 shows the simple form of the instrument 
consisting of a 40 cycle phase shift oscillator, silicon 
control switch and a unijunction transistor pulse generator. 
The reader presses the momentary switch at the time he 
announces the page number. At the instant the pushbutton 
is depressed, the silicon control switch is turned on ani 
the oscillator is activated. At the end of approximately 
five seconds, the UJT pulse generator fires a '/turn off" 
signal disabling the circuit. During the quiescent period, 
battery drain is approximately equal to open circuit con- 
ditions. 

The unit is constructed in a small "mini" box 
approximately 1-1/2 x 2 x 3 inches. The microphone 
plugs into a jack at one end which ^eeds directly through 
to the output cord going into the tape recorder. (See 
figure 2). 

Experiepces with the indexer have prompted the 
design of a more elaborate version, offering two signal 
choices. As may be seen by examinii^ the block diagram, 
figure 3, this model consists of a similar phase shift 
oscillator connected to the supply through two SCS 
switches in series. When the second SCS (D 2) is not in 
the circuit, the operation of the unit is exactly as 
described above. However, when the lower SCS (D 2) is 
in the circuit (S 2 Open) operation is as follows. 




FIGURE 2, The self-timing tone generator 

plugged into a tape recorder and 
ready for use. 
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FIGURE 3. Block diagram of a more elaborate 
tone generator which provides two 
signal choices. 
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When the momentary switch is depose ssed (S 1) , 
the top SCS (D 1) and the bottom SCS (D 2) are both turned 
on and the three UJT timing circuits are started. The top 
right timer (Q 3) is set to generate a turn-off pulse M the 
end of 5 seconds. The bottom right UJT (Q 4) is set to 
turn off after .5 second. The UJT at the left (Q 2) is set 
to turn on the second SCS after one second and restart 
the lower UJT timer. Thus, when the circuit is activated, 
the top SCS is turned on for 5 seconds, while the bottom 
SCS is turned on for . 5 second off for .5 second and so 



forth until the top SCS is turned off, thus completing the 
cycle. The detailed circuit is shown in figure 4. 

In use, this indexer is employed to provide the 
interrupted tone bursts to indicate chapter headings or 
other major divisions in the text while the continuous 5 
second tone may be used simultaneously with the reading 
of page numbers. It should be noted that two adjustments 
are available in both models. One is a feed-back adjust- 
ment in the oscillator circuit (R 19) while the other is an 
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output level adjustment (H 20). In practice, the output 
should be adjusted to where it is approximately equal to 
that of the microphone being used. When this adjustment 
is correctly made, the listener is unaware of the signals 
on the tape when listening at normal tape speeds. When 
the tape is sampled in the fast forward or fast reverse 
mode, these signals become clearly audible as a short 
whistle, in the case of page indicators, or a series of 5 



very short tone bursts, similar to the Morse code 
numeral 5^ in the case of the chapter heading indicators. 

These circuits have been developed in cooperation 
with the Rehabilitation Materials Unit of the Bureau of 
Rehabilitation Services by the author and Mr. Dean Blazie 
a graduate of the Department of Klectrlcal Engineering, 
University of Kentuckj'. 
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FIGURE 4, Detailed circuit of the self -timing 
page marker * 
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AN AUTOMATED READING SERVICE FOR THE BLIND 



by 

J. Gaitenby, G. Sholes, T. Rand,* G. Kuhn, * P. Nye, F. Cooper 

Haskins Laboratories 
New Haven, Connecticut 06510 

Abstract 

This is a progress report concerning the state of the reading 
machine that has been designed and developed at Haskins Laboratories, 
and that is about to be evaluated in field tests. Aside from being exposed 
to standard comprehension tests, and making judgments on rate 
preferences, blind students — performing as subjects in the testing — ^will 
assess the relative utility of synthetic speech recordings in comparison 
with face-to-face readings and naturally-spoken tapes. 



Introduction 

We are concerned with the problem of getting the 
results of research on a reading machine for the blind out 
of the laboratory and into application. The reading 
machine in question converts printed material to synthetic 
speech. It is hoped that within three to five years a pilot 
version of the machine can be installed in a university 
library to assess the feasibility of eventually constructing 
a larger-scale, automated reading service for the blind, 
perhaps on a national basis. At present the methods for 
text conversion to artificial speech, and the speech itself, 
have reached an advanced stage of development. An 
optical character recognition device, forming the input 
the system, will be received from a manufacturer within 
a few months. Meantime, editing of the "spelling and 
sound" dictionary (in which text word orthography is 
matched to phonetics) continues with further refinement 
of the dictionary word retrieval and stress assignment 
programs. Modifications in the speech synthesis procedure 
are under way for improving the naturalness of the spoken 
output, and on a separate front, attention is being directed 
to the planning and arrangement of extended evaluation 
studies using texts generated in synthetic speech. This 
paper contains a short description of the steps used in the 
automated reading process and some of the plans for a 
full scale evaluation of the synthetic speech output. 

There will be very few, if any, blind people present 
who will dispute that existing reading services which use 
tape recordings have shortcomings. These become par- 
ticularly obvious when the services attempt to produce 
new tapes of recently published books. Sometimes months 
can elapse following a request, before the recording is 
completed and the last chapter is received by the 
subscriber. The reason for these delays do not stem 
from glaring faults in the structure and efficiency of the 
organizations involved, but rather from the fact that they 
both must employ human readers. For no matter whether 
the reader is an actor »vorking for a fee, or a volunteer, 
he or. she must schedule visits to the recording studio 
when the facilities are available, and can then only work 
for an hour or two at each session. Therefore, a major 
limitation lies with the human reader and a solution to 
part of the problem appears to be available through the 
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use of reading machines. 

Techniques for recognizing printed characters and 
for sjmthesizing speech have been steadily improving over 
the past fifteen years. During this period the staff of 
Haskins Laboratories have been concentrating their 
efforts on the problems of speech synthesis and, with the 
support of the Veterans Administration, have been 
actively engaged in the development of a reading machine 
for the blind. At this point in time, sufficient progress 
has been made to make it quite obvious that a complete 
reading machine, which can produce speech from a 
printed page, can now be made. In fact, with the 
acquisition of an optical character recognition machine 
provided by the Seeing Eye Foundation, we expect to have 
a complete working model in the laboratory a ithin the 
next few months. We have been able to generate lung 
texts in the synthetic speech output for about two years, 
and stress and intonation assignment is programmed in 
addition to the earlier speech synthesis by rule. 

The speech, as synthesized, is not perfectly natural 
and requires a little exposure to become used to. However, 
the words are delivered at a final rate of over 160 words 
per minute and I am quite sure that if you were to hear the 
tapes and then if I were to ask you questions about them, 
you would be able to provide satisfactory answers. My 
confidence in your probable reactions is due to the fact 
that ve have run pilot tests on comprehensibility of the 
material with coHege students, blind veterans at the 
Eastern Rehabilitation Center of the West Haven Veterans 
Hospital, and with ourselves as subjects. 

^ The results of these tests have been most encour- 
aging and we feel that the reading machine system could 
be of real utility, particularly to blind students. However, 
in our efforts to apply the machine to student needs, we 
find ourselves obliged to take on several new problems, 
many of which lie outside the usual confines of a research 
laboratory. In fact it is becoming clear that it will be 
necessary for us to conduct a thorough analysis of the uses 
to which synthetic speech can be put, and eventually to 
build at least one pilot reading service center before other 
agencies are likely to grasp the initiative. This means 
that we must continue to use our laboratory facilities for 
generating synthetic speech, and must conduct an 
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extensive evaluation program in an endeavor to provide 
sufficient evidence to justify the investment needed to set 
up a Reading Service Center. 

The Application cf Reading Machines 

We anticipate that the Reading Service Center (in 
which the reading machine will operate) will be located 
in a library. There the Center will convert printed texts 
to synthetic speech and record the outputs for use by a 
large number of blind subscribers. The reading service 
can be provided in response to either a personal request 
made at the library or to a phone call. At the time his 
request is filed, the user may specify the word rate at 
which the material is to be recorded* as well as the book, 
article, chapter or page he needs. Within a comparatively 
short time (minutes, hours, or possibly days, if request 
traffic is exceptionally heavy) he may pick up, or have 
sent to him, the audio tape of the entire text desired* 

Because of present limitations on the naturalness of 
synthetic speech, it is apparent that a reading service 
involving text-to-speech processing by machine can only 
supplement — and will certainly not supplant — existing 
reading services (1). Thus, book production in Braille 
(as at the American Printing House for the Blind) and 
spoken tapes issued by Talking Books, Recording for the 
Blind and other organizations, may long remain primary 
sources of reading material for the blind. However, in 
the educational field where there exists a widespread need 
for more, and more rapid access to the printed word, it 
is probable that blind studetvts will frequently be prepared 
to accept a somewhat unusual voice output in exchange for 
an extremely fast supply of diverse published material 
(that is not immediately available by any other means). 

The Text-to-speech System 

The procedural steps in the reading machine system 
designed at Haskins Laboratories have been detailed in 
several other publications and only a short review will 
be given here. After the printed text has been read into 
the machine, three successive transformations are 
involved: the first from English spelling to phonemic 
transcription of the same words; the second, from a 
phonemic transcription to control signals; and third, from 
control signals to audible synthesized speech (2). In 
somewhat more detail, following Nye, et al. (3) the text- 
to-speech processing is accomplished as follows: 

The requested text is scanned by an optical char- 
acter reader (OCR). (The Cognitronics System 70 page 
reader, a machine that recognizes OCR-A upper and 
lower case typefont, is to be used for the scanning 
operation. ) The OCR output, stored on digital magnetic 
tape, is transcribed into phonetic spelling with the aid of 
a 140,000 word text-to-phoneme dictionary that is stored 
in computer memory. 

This stored dictionary, which was culled from the 
dictionary prepared by Dr. June Shoup and associates at 
the Speech Communication Research Laboratory, has 
undergone extensive revision to make it compatible, with 
the local computer programming. The vocabulary has 
been separated into two units: a small high frequency 



word list is stored in core memory while the main lexicon 
is held in disc storage. Any text word encountered in the 
scanning stage is first searched for in the high fx'equency 
list, and if not found, the se^arch of the main unit then 
proceeds. When the phonetic words of a sizable body of 
text plus their grammatical categories have been retrieved, 
a pseudo -grammatical comparison of successive paired 
words is made, and, using a system of lexical and 
punctuational rules, stress symbols are assigned which 
are appropriate to the context (5). The resulting 
prosodically annotated string of phonemes (in machine 
language) are processed by the Mattingiy (4) program for 
Speech Synthesis by Rule, and control waveforms for the 
specific textual message at a predetermined speed are 
computed. These waveforms control the synthesizer and 
generate intelligible speech at the specified word rate. 
The output of the synthesizer is recorded on standard 
audio tape and conveyed lo the blind user. 

To facilitate the making of further improvements in 
the operating system, the laboratory machine includes 
facilities for manual editing of the dictionary, the phonetics, 
and the acoustic components of the message, together 
with visual displays (by means of a CRT) of each of these 
aspects. This allowance for editorial intervention is an 
important developmental feature, but it will of course not 
be essential to the final reading system. However, while 
the field evaluation is in progress, substantial feedback 
from the separate tests is expected, and what is learned 
can be structured into on-going modification of the speech- 
producing program. 

Field Evaluation 

The purpose of the evaluation tests will be to 
attempt to answer questions concerning human factors, 
cost versus benefit, and technical matters (3). In pilot 
studies conducted over the past 18 months we have had 
the cooperation of faculty and students at the University 
of Connecticut and at the VA Hospital in West Haven, and 
it is anticipated that in the conduct of the detailed 
evaluation study we will again rely upon both of these 
institutions for assistance in test design, acquisition and 
scheduling of testees, and administration of the tests. 

Some of the test material (rhyme tests, for example) 
will be of a standard nature and has been used elsewhere 
for such applications as assessing telephone speech 
quality. Also, we intend to use reading comprehension 
tests similar to those used in the public education system « 
On the other hand, certain tests will be created specifi- 
cally for appraising the synthetic speech medium. 
Various levels of textual material will be presented, in 
a variety of subject matter, by a range of authors. 
(Authors^ styles and vocabulary are known to produce 
differing degrees of acceptability among readers.) 

Beyond the standardized and specially -designed 
listening tests f we propose to operate a partial Reading 
Machine Service for blind students at the University, in 
order to make reasonable estimates of time and expense 
involved in actual text-to-speech-to-user production, 
and in order to make a genuine test of the feasibility of 
the system. The magnitude of demand by students for 
the synthetic speech recordings of their actual textbook 
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assignments (using this partially simulated system) should 

be indicative of the contribution a full scale installation of 

a Reading Service will provide (although it is recognized 

that an innovation such as synthetic speech may encounter 

initial resistance). Demand itself is, of course, one 2. 

clear type of acceptability measure. 

When enough data has been gathered to permit a 
comparison of synthetic speech tapes and natural speech 3. 
recordings across such factors as demand, production 
speed, cost and acceptability, wc should then have arrived 
at a realistic index oi the new system's overall feasibility. 

In summary, a bench model of an automated reading 
system for the blind exists. Pilot tests cf the acceptability 4. 
of the synthetic speech output have been conducted, and 
the system is now ready for serious evaluation. Coopera- 
tive university and veterans' facilities are on hand to 
contribute their assistance in this enterprise. The evalu- 
ation study itself represents a start on moving the system 5. 
out of the laboratory and into real -life application. 
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AN ON-LINE SYSTEM FOR IMMEDIATE BRAILLE PRESENTATION 
OF COMPUTER-STORED INFORmTION TO THE BLIND 

by 

Arnold P. Grunwald 
Argonne National Laboratory 
Argonne, Illinois 60439 

Robert H. Vonderohe 
University of Chicago 
Chicago, Illinois 

The ever-increasing use of automated data processing facilities at 
all levels of business operation makes it necessary for an individual who 
wants to operate in these areas to be capable of bi-directional communi- 
cation with such data systems. This presents particular problems to the 
blind: while they are quite capable of uni-directional communication with 
existing data systems through keyboards and other standard input devices, 
the blind can, at present, receive output only in cumbersome and 
frequently ineffective ways. Effectiveness of the blind in these environ- 
ments is hampered by the inability to accept standard output such as 
teletypewriter output, printed listings, and\;haracter displays. 



In the last several years, a number of attempts have 
been made to facilitate output for the blind. These 
attempts have taken the form of braille computer listings, 
embossed tape, devices to read standard print, etc. 
Each of these methods provides some capability for the 
blind. However, each has drawbacks and none exhibits 
the speed and selectivity required by an efficient data 
system urcr. Their availability is generally limited by 
the requirement that an employer provide modifications 
of his system to accommodate blind users and, further- 
more, where speed is essential, the blind person's 
limited ability to scan or skim over a mass of data is not 
helped in the output approaches mentioned. 

One of the devices which are employed in computer- 
based data systems at a rapidly increasing rate, is the 
video terminal. This device communicates bi-directionally 
with a computer system by direct connection or via 
telephone lines. Input facility is provided generally by a 
standard keyboard plus various control keys* Output is 
provided by a cathode ray tube which displays alpha- 
numeric information. This device permits the user to 
rapidly and selectively inspect large quantities of data as 
well as modify, delete or add to the computer files. Many 
corresponding jobs require no uncommon or highly 
developed skills and the bulk of computer related jobs in 
the business sector are in this category, that is, they can 
be mastered relatively easily if one can use a video 
terminal. Thus, to open up employment opportunities for 
the blind, it would be highly desirable to provide employers 
with a device which can be easily substituted for a video 
terminal, and at the same time, has an output mode 
suited for a blind operator. 

To date, no one has solved the problem to provide 
such a terminal environment. More specifically, no one 
has offered to the blind a braille substitute for the cathode 
ray tube. In the general case, at first inspection, the 
problem appears merely to be one of substitution. If, for 
instance, the display had 20 rows of 72 characters each, 



the requirement is to merely provide 20 rows of 72 char- 
acter braille transducers. At closer inspection, this 
direct substitution appears neither desirable nor tech- 
nically feasible. 

First, at normal braille cell spacing (approximately 
1/4 inch) each line would be eighteen inches long without 
any provision for escape characters. With the required 
escape characters, the lines could easily be 20 inches 
long giving a minimum 20-inch by 8-inch area. One 
doubts the utilization of such an area for long periods 
without excessive arm fatigue. Secondly, the provision 
of such a braille array at normal cell spacing utilizing 
solenoids or similar electromechanical devices is at 
best a nightmare. Similar problems exist to some degree 
with a parallel (printer t3rpe) embosser. Third, and most 
importantly, one must consider the difference in infor- 
mation assimilation technique between the sighted and 
the blind. For the blind, the normal sighted eye -scan 
cannot be duplicated. Information must be assimilated 
almost strictly serially because of the characteristics of 
tactual sensors. This means that the presence of, say, 
an entire page of information ceases to be an advantage. 
Therefore, textual information presented to the blind must 
be augmented by nontextual information in the form of 
grouping and Indexing so that the tactile equivalent of the 
sighted scan may be performed. Fortunately, the infor- 
mation required In the performance of moderately skilled 
jobs (e.g., order taking, information service, etc.) 
typically resides already in the machine in correspondingly 
organized form; the twofold problem is, therefore , 
essentially reduced to the single one of providing a suit- 
able output and control set. 

The most promising approach appears to be a 
serial output device, with appropriately high speed 
capability and with sufficient control to permit the oper- 
ator wide latitude in the selection of information. A 
device which appears to have these characteristics is the 
Argonne Braille Machine display mechanism. 
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FIGURE i. Block diagram of a facility with an* embedded 
braille terminal. 



This Argonne Braille Machine is really one part of a 
fairly extensive system which has several far reaching 
aspects. What concerns us here is the braille display 
mechanism used in this machine. 

Obviously, there is only a limited number of modes 
or ways of how one can display braille. One such mode 
may be called stationary, another one dynamic, which 
means a stationary display would be one {\ike a page of 
braille on a table) which is there for the reader to do 
something with. On the other hand, a dynamic display 
would be, for instance, a set of characters moving under 
the reader^s fingertips where the person just watches 
what is going on. There are other basic modes one can 
thinli of; let's take a line as an element. It can be 
displayed in full length and after it has been read, it is 
removed and the next one appears, or you could move 
normal to the reading surface to present and remove 
characters formed, for Instance, by rising and falling 
pins. Conversely you could have» as the principal mode 
of a dyn«imic display, a line which is endless and just 
moves from right to left through a window, so that the 
sensation, if you hold your fingers to the window, is 
essentially the same as if you sweep the line on a 
stationary display with your fingers. 



V Q do not propose to go into all the combinations and 
permutations here. But we did try to explore possible 
modes somewhat systematically. For this purpose , we 
built a device which allows to move a sheet of paper with 
embossed characters in different modes stepwise up, 
continually up^ sideways stepping and continually, in 
various increments and with adjustable speed. The only 
mode that people couldn't read at all was several lines 
available at a time and kept in a steady upward motion so 
that one has a relatively large set of characters at any 
one time accessible. But, as mentioned, this mode does 
not work. The sweep by the user's hand from left to 
right and the movement of the characters set from the 
bottom up left the user with no fixed reference ^ and he 
kept losing his place. Conversely, tests with a line 
moving constantly from right to left with adjustable speed 
seemed, from the standpoint of the reader, the most 
favorable ones and it turned out from an engineering 
standpoint also preferable to anything else; maybe it's 
just because we know how to do it or that we found out 
how to do it, but wc think there is a systematic advantage 
in this mode. 

We then designed a machine which contains a plastic 
belt which runs over a platen and recirculates around two 
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THERE AR£ 5 HAND/ITCRY FIELDS IN BUILDING A PASSE7IGER RECORD. IP AKT CNE 
OF THEK IS DELETED, XFOLU) VaLt NOT ACCEPT THE RECCRDt 

I. ITINEHARY FIELD 

A. Flight Segment * Thia consists of airline, flight If, class of 
service, date and months origin, destination, action taken, 
0 of seats, departure time> and arrival tine* 
B* Axixiliary Services - Thia consists of hotel, car, tour, llmo, 
etc* requests* Required information to enter it la the 
auxiliary coda (htl,ear^tur,lljn,8ur}| airline, action taken, 
city^ date and month* 

n* NAME FIELD 

A* N:l Kaxwoll/J » one sumane . 

N:l Maxwell/J Nsl Roberts/T ^ more than one surname 
B* Cross-reference 
C* Name changes 
D« Infants 

HI. CONTACT FIELD ' 

A. P:CHIB/312 268-951iO x3l/8/312 2754*830 - phone 

B* P:CHIA/Res/I221 N* Harlem Chicago Illinois 606U7 ^address 

IV. TICKETING FIELD 

A* Ticketed 

B* Pta 

Cm Revalidation 

D. Ticket by mail 

E. Ticket office will call 
F* Airport will call 

0. Teletlcketing 

H. Other airline ticketing 

V. GENERAL FACTS FIELD 

Information which is valuable to us but does not need to be transmitted 
to the airport or ticket counter. 

VI.- SUPPLHMQITARY INFORKATION FIEID 

Requests vhlch require advance action or a reply. 

VII. RECEIVED FIELD 

Identifies the caller 



— Schedule changes are handled ^th special action codes within the Itinerary. (^ut4,*J^K,Sc^ 

To determine the path a certain flight travels enroute to its destination: 
VITflt*jf^/dateandmonth example: Vrr3li6/2£jan 

The response vlll be cities the flight goes to at the left and times of 
departure and arrival at each ciiy on the right* 

A function to divide a party of 2 or more into separate 

1) Dl«3 ** Asking Apollo to give you only the first and 
third names out of the group of names* 

2) DlU2Xelly/VHstr T -* Asking Apollo lo give you 
Mr and son out of the rest 
of the family. 

FIGURE 2. Page from a training manual depicting an example 
of information such a system wight deal with. 
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pulleys. There are some mechanisms which do the 
writing and erasing of characters on this belt; a reader 
puts his fingers on the belt on the platen - and here we 
go! A sensitive trigger under the platen starts the 
transport and a selector switch provides different modes 
of operation and finally there is a speed control for the 
operator to use. One can, of course, if one misses a 
character, move on with the belt a little, to spend a bit 
more time with each character; then, later on, one has 
to make that up by shifting one's hand gradually back 
upstream. In short, there is some buffering available 
in a dynamic display* The average rate is, however, 
adjusted to suit conditions by means of the speed control* 

With such an output device, the pr )lem becomes one 
of optimizing the man-machine interaction (cybernetics)* 
In this matter, one needs to consider learning mechanisms 
of the blind. For example, blind people achieve quite 
satisfactory mobility, particularly in familiar surroundings 
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Contrary to some seeing peoples' ideas, for instance, the 
number of piices between objects are not committed to 
memory, but they appear to develop, from a multiplicity 
of clues, a subconscious awareness of topography. It is 
this type of ability which must be counted on for the 
terminal design. A number of interesting tiuestions arise, 
such as: 

1. How general in ruiturc or specific to a partic- 
ular application (job function) should the 
terminal be ? 

2. What design features would minimize job 
training requirements? 

3. What should be the physical placement of the 
output device relative to the keyboard to 
facilitate the input -outpui. dialogue ? 

4. What ''start", "stop" and/or "speed" control 
(knee, foot, etc.) should be provided for 
optimum utilization? 

5. Should an audio indicator be provided to 
announce the arrival of information from the 
computer? 

6. Are normal video terminal cursor selection 
controls (LEFT-RIGHT -UP-DOWN-CARRIAGE 
RETURN-HOME*, etc. ) sufficient for braille 
information selectivity? (e.g. , column scan). 



*The normal cursor "HOME" position refers to the first 
character position (character "1" on line "1") on the video 
"page". 




FIGURE 5. Argonne Braille Belt with cancellable 
"dots" arranged in standard braille 
cells* 
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FIGURE 6 , K rasing and resetting mecbani sms 
of the Argonne Braille Machine, 



Answers to these and other questions must be 
studied. It is antieipated that this ean be done without 
tjreut diffieulty. 

A neeessary objeetive in providing a deviee of the 
Kind diseussed for the blind is that it would re(|uire no 
modifieation to the host system beyond that normally 
required for the variety of video termimils being marketed. 
This requirement does not appear to present a major 
restriction for several reasons. First, memory is 
ordinarily provided at the terminal from which the video 
display is refreshed. The same (type of) memory will 
provide the braille output as requested by the operator. 
This means that additional logic will be provided in the 
braille terminal for alphiinumeric to braille character 
conversion, as well as escape character generation (not 
a formidable task in Braille I). Second, both the memoi'y 
and the keyboard will appear electrically identical to a 
standard terminal unit. 

A terminal of the type described has applications in 
many areas where computer -based data systems are 
currently in use. 

At this time, at least four areas of application of 
the device are apparent: 

1. Clerical positions in such areas as: 

a. Airline reservation 

b. Order taking and inventory control 

c. Credit file searching 

d. Sei^ice representation 

2. Managerial positions involving decisions 
made on the basis of computer-based files. 

3. Professional positions, primarily in tech- 
nical areas, ranging from computer pro- 




FIGURE /. Braille macnine being used. 



gramming to computer work in science; 
other areas of science and engineering 
may also provide opportunities for uti- 
lization. 

4. Computer Aided Instiniction (CAI). In 

this area, the blind could be on a par with 
the sighted} and no distinction in the 
presentation of materials need be made. 

As an example of how such a braille terminal might 
be used, consider an application with an airline reser- 
vation clerk. (Figure 1 is a block diagram of how the 
braille terminal would be connected in place of a stan- 
dard terminal). Figure 2 shows a facsimile of a list of 
instructions for operations performed while interacting 
with a prospective customer (passenger) and a computer. 
During this interaction, the clerk communicates with the 
prospective customer via telephone, and communicates 
with the computer. via keyboatd and terminal display. 
The computer, which has schedules, availability, and 
othcK supportive information stored in its memory, is 
programmed to selectively provide such parts of the 
available information as are specified by the operator. 

The clerk, whether handicapped or not, would on 
request give the caller information on schedules, avail- 
ability of reservations, known delays for particular 
flights, connections^ ticket pricing, etc, , all of which can 
be obtained from the computer in a programmed fashion. 
For instance, the operator may ask for the ''first nonstop 
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flight after 11 a.m. from Chicago to Boston with seats 
available. " While interacting with the customer, the 
clerk can make preliminary entries in the computer memory 
(taking notes, as it were). After the customer has 
decided on a booking, the clerk will confirm (from notes 
retrieved from the computer on his display) the details of 
the reservation to be made. He then enters the corre- 
sponding booking (the passenger record) in the computer 
by means of his keyboard and erases the notes from the 
computer memory, thereby completing the clerk's function. 

In this kind of applj/r ition., the information sent to and 
received from the computer is highly organized and coded; 
thus, the operator need not sift through a mass of data to 
obtain the answer to his inquiry and the number of char- 
acters that need to be displayed and read is small* Con- 
sider for an example the following possible computer 
response for the above request: (First nonstop flight 
after 11 a.m. from Chicago to Boston). 

11:00a 2:05p UA 699 F/Y DIO L 0 

To request this output line and accompanying lines, 
the operators must first know the code for both departure 
and destination to type in as entering arguments (e.g. , 
ORD is Chicago O^Hare Airport). This does not pose a 
serious problem to a blind operator any more than to a 
nonhandi capped person; as a matter of fact, he may be 
expected to be especially well prepared for responding 
to clues to information (which is almost synonymous with 
"decoding") by his usual daily chores. This would seem 
generally true because much of the information provided 
for in an environment designed for the seeing must be 
inferred indirectly ("decoded") by the blind. Furthermore, 
specifically the usage of Grade II braille would appear to 
be conditioning beneficial in the outlined work situation: 
the Grade II code, relying on context of word and sentence 
structure and even on conceptual content of the message 
transmitted in the rules of usage, cannot but develop 
agility in dealing with abstract "languages"* 



To envision corresponding procedures in some detail, 
consider again an airline reservation desk; parts of an 
inquiry may concern questions such as, "Is lunch served 
on the flight in question aboard a DC -10 aircraft?", etc. 
This type of knowledge is acquired through normal oper- 
ator training. Remember, in the previous example, that 
perhaps ten corresponding lines would be stored in the 
terminal memory; thus, the operator could specify which 
part of this information he wants to appear on the braille 
display. The operator could begin by hitting the "Home" 
key which sets readout to the beginning of the first line, 
hit the "Right" key to read across to the arrival time of 
^2 :05 p. m. , hit the "Down" key to column scan the arrival 
times, hit the "Carriage Return" key to start at the 
beginning of the desired line, and then hit "Right" again to 
read that line. The formatting for the above hypothetical 
operation should, of course, be carefully chosen, e.g. , 
should "Right" and "Left" initiate continuous readout or 
the readout of a known group of characters. 

I While many answers must yet be determined and 
operator techniques developed, the authors feel that a 
braille computer termini as described here could well 
provide employment and educational opportunities for the 
blind which has as yet been virtually untouched. The 
design of such a system does not seem to present insur- 
mountable difficulties. 

The authors acknowledge that Mr. Robert Humbert 
of the American Association of Workers for the Blind in 
Oakland, California has first alerted them to the potential 
of this application of the Argonne Braille Machine. 

United Airlines has kindly provided us with valuable 
details of the environment and mode of operation of airlines 
reservation facilities. 

Dr. Lois Leffler and David Jacobsohn (of the Applied 
Mathematics Division of ANL) participated in a preliminary 
study of the subject. 



ERIC 



\ 



TOWARD .IMPROVING THE OPTACOX 



by 

1 Jon C. Taenzer 

\ Stanford Research Institute 

Menlo Park, California 94025 

Abstract 



The Optacon — a successful optical-to-tactile- 
convorsion reading aid for the blind— has histori- 
cally had a display windoAk of slightly less than one 
letterspace. What would be the effect of widening 
that display window? 

In finding an answer to this question, a model 
of the human reading . system has been formulated, 
based upon the results of several reading experi- 
ments (both visual and tactile). The model indi- 
cates that there is a mental processing period with 
an average duration of 90-95 ms. It also indicates 
that new information is accepted only at the begin- 
ning of a pi'ocessing period. However, a single 
"load" of inlormation may utilize one, two, or more 
consecutive processing periods. In addition, the 
source of information (tactile, auditory, visual, 
etc.) may be different each time new information is 
accepted, which is simply an embodiment of the time- 
sharing principle. 

Since these characteristics are general, the 
model is actually applicable to a wide range of 
mental tasks extending well beyond reading. As it 
applies to the reading task, however, this model 
closely predicts data from several reading e;cperi- 
ments. It has given us a much better understanding 
of the interactions involved in reading. The model 
also shows ways for improving the Optacon so that 
better reading performance can be attained by the 
blind reader, and these improvements are being ex- 
perimentally verified at this time, 

Introduct ion 

The Optacon — a successful optical-to-tactile- 
con vers ion, direct-translation reading aid for the 
blind — was originally conceived in the early 1960's 
by Dr. John Linvill at Stanford University. In con- 
cept, this device consists of an array of photo- 
sensors connected to an array of tactile simulators 
by some appropriate electronics. When an area of 
print is imaged upon the photosensor array, a corre- 
sponding tactile image is reproduced on the stimula- 
tor array. This tactile image, which is a direct 
facsimile of the area of print, is in turn sensed by 
the blind reader. Figure 1 shows an Optacon in use. 

Constant-Rate Reading 

While Dr. Linvill and his associates were study- 
ing the feasibility of producing a working Optacon, 
one quc.«5tion repeatedly arose: What is the best dis- 
play winduw width, i.e., horizontal f ield-of-view, 
to use? In 1965, Bliss made an initial measurement 
of the effect of window width changes, and the results 




FIGURE 1. SUBJECT USING A RECENT MODEL OF THE 

OPTACON. The camera is held in her right hand 
and manually scanned across the print while she 
detects the tactile images with the index finger on 
her left hand. 



of his experiment are shown in Figure 2.(1) Bliss 
used a 12-row high array of tactile stimulators 
placed against a single finger tip. Tlie stimulators 
were driven by a computer-generated, constant-rate, 
moving-belt display of English prose at 24 wpm. The 
window width was varied by changing the number of 
active display columns. He found that the reading 
rate, as measured in correct words-por-minute, in- 
creased as the window width increased from zero to 
a hall of a letterspace <i>s). (A letterspace is <le- 
fined as the width of a letter plus the space between 
it and the next letter.) However, no additional in- 
crease was recorded when the window width was in- 
creased further. Since there was reason to believe 
that the subject's finger did not adequately contact 
the array over more than half a letterspace, it was 
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FIGURE 2. flESULTS OF A TACTILE READi:JG EXPERIMENT 
BY BLISS One subject after 21 hours of 

training — average of three trials. 



FIGURE 3. RESULTS OF A VISUAL CONSTANT-RATE 

EXPERIMENT. Average -esults for four subjects after 
12 hours of training. 



assumed that the reading rate would continue to in- 
crease for wider window widths if the additional in- 
formation could be adequately displayed to the 
subject. 

In 1968, I ran a similar experiment in which the 
reading was done visually using a light box display 
(2), The display parameters were virtually identical 
to those that Bliss used. Figure 3 shows the results 
of that experiment. For window widths up to 0.5 is 
the results are practically identical to those re- 
ported by Bliss. Beyond 0.5 ^s the continuing in- 
crease that Bliss expected is also evident. It was 
somewhat surprising to find that the visual and tac- 
tile reading results were nearly identical — at least 
for small window widths. This was one of the earli- 
est indications that both visual and tactile informa- 
tion is handled by the same mental processing 
mechanism. 

These measurements at 24 wpm have a limitation 
however: the curves saturate at 100% accuracy for 
window widths of 1.0 is or more. In order to measure 
the effect of wider windows, the display rate must be 
increased. Therefore 1 ran the same experiment again, 
but at a 60 wpm display rate. All other parameters 
remained the same. Figure 4 shows the results of 
this higher rate experiment. The reading speed con- 
tinued to increase to the 1.5 Zs limit of our dis- 
play. Thus the data indicates that higher reading 
speeds and wider window widths go hand in hand. 



If you have been looking closely, you have no- 
ticed that the shapes of the two visual curves are 
nearly identical. The major difference is that the 
higher display rate curve is displaced to the right 
of the lower display rate curve. However, if the 
visual results are plotted as word accuracy versus 
display time , where display time is defined as the 
amount of time any part of a letter is being dis- 
played while moving from the right edge to the left 
edge of the window, then a single performance curve 
results. For any combination of window width and 
display rate there is a unique display time. The 
display time, t^, is given by 



(I) 



where Wis the window width and is the display 
rate. Figure 5 shows the performance curve that re- 
sults from this manipulation. It indicates that for 
display times of 50 ms or less, word reading is 
nearly impossible. As the display time increases 
the accuracy increases reaching 50% at 95 ms display 
time. Likewise 95% accuracy, which closely corre- 
sponds to 100% comprehension, is achieved with a 
150 ms display time. Thus, for constant-rate dis- 
plays, these data indicate that the effect of changes 
in window width follow Equation (1) with the display 
time, t^, being a constant having a value of 150 ms 
for high comprehension reading. Equation (1) is a 
linear relationship where doubling the window width 
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FIGURE 4. RESULTS OF A HIGHER RATE VISUAL EXPERIMENT. 

Average results for four subjects after 12 hours of training, 



control of the reading process the free-rate reading 
situation. Free-rate reading is different from 
cor,stant-rate reading in two important ways. First, 
the reader has control of the rate at which the 
textual information is scanned, and therefore he can 
tailor his instantaneous scanning rate to his own 
instantaneous mental information processing speed. 
Secondly, free-rate reading entails the control of 
some mechanical scanning mechanism, such as the eye 
(for visual reading) or the arm and hand (for Optacon 
reading), and some mental processing time must be 
devott . to this tracking task. Therefore free-rate 
reading could be faster or slower than constant-rate 
reading depending on whether the increase due to 
being able to match the scanning rate to the proces- 
sing requirements offsets the decrease due to the 
added tracking task. | 

In order to determine some of the effects of 
reader control, an experiment was run with an Optacon 
and blind subject (5). In this experiment the 
scanning time was monitored for each word that was 
read. Scanning times were determined to the nearest 
millisecond by a computerized measurement system 
operating in conjunction with a Graf aeon tablet. The 
Graf aeon tablet (like a Rand tablet) determined the 
X - Y position of the Optacon camera and told the 
computer where the subject was reading in the text. 
Thus the computer was able to calculate the scanning 
time for each word of the text whenever a word 
boundary was crossed. The textual material had a 
total of almost 1500 words. 
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FIGURE 5. PERFORMANCE CURVE THAT RESULTS FROM THE 
COMBINED 24 wpm AND 60 wpm VISUAL DATA 



doubles the readable display speed. Although these 
experiments involved window widths of less than 1.5 
j^s, the results of experiments performed by Poulton 
(3) and White (4) indicate that Equation »(1) holds 
out to 5 or more letterspaces. 



After having collected the data, the effects of 
word length and word rank were investigated, and it 
was found that the average scanning-t ime-per- 
letterspace was quite constant over wide ranges of 
these variables; the overall average scanning-t ime- 
per-letterspace being 141.1 ms. However, the scanning 
time histograms for each word length, as shown in 
Figure 6, show details which cannot be accounted for 
by the noise in the measurements. If these scanning 
rate variations are somehow connected with the sub- 
jective meaning in the text, then variations with 
word length or rank would not necessarily be noticed, 
and yet the scanning rate measurements would contain 
a lot of information about the mental processing in- 
volved in reading. It was decided to formulate a 
mental processing mechanism model which would, hope- 
fully, provide a good fit to the measured scanning 
time data, and such a model has been found. This 
model, which can be described in mathematical terms, 
represents the probability that the information con- 
tained in each window width of distance along a line 
of text will be correctly Identified. A detailed 
description and mathematical derivation of the model 
is given in Reference (6). I will not repeat that 
exercise here but will, instead, give some of the 
features of the model. 



Free-Rate Reading 



Mental Processing Model 



Since a cojistant-rate display does not involve 
any action on the part of the reader, it is not re- 
presentative of the typical reading situation. I 
call a reading situation where the reader has complete 



The mental processing model is based upon several 

assumptions. First of all, it is assumed that there 

is a mental processing period during which the pro- 
cessing of information is accomplished. New 
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FIGURE 6. HISTOGRAMS OF THE SCANNING TIME DATA FROM A FREE-RATE 
TACTILE READING EXPERIMENT. Also shown are the smooth 
curves that result from the mental processing model described in {A). 



information is accepted only at the beginning of a 
processing period. Furthermore, new information can 
be accepted from any source at the beginning of any 
processing period^ or, to put it more simply^ the 
processing mechanism is time-shared. It is further 
assumed that the duration of all processing periods 
is not precisely the same^ but rather varies in a 
gaussian manner with mean and standard deviation. It 
is also assumed that a single load of information can 
be retained by the processing mechanism for any 
number of processing periods if necessary. 

These features were incorporated in the mathe- 
matical model and a computer-based curve fitting 
exercise was performed using the model and the ex- 
perimental data. Figure 7 shows the resulting single- 
window-width probability density function. Since the 
Optacon which was used for this experiment had a 
window-width of very nearly one letterspace, the 
probability density functions for words of any length 
can be produced by convolving the single-window-width 
probability density function with itself — once for 
each character in the word. The scanning time histo- 
grams are simply the measured versions of these 
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FIGURE 7. THE SI NGLE-WIN DOW- WIDTH PROBABILITY 

DENSITY FUNCTION GIVEN BY THE MENTAL 
PROCESSING MODEL. 
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density functions. Figure 6 compares the results from 
the model with the experimental data. 

By fitting the model to the data, numerical 
values for some of the features of the model can now 
be identified In Figure 7. The peaks in the figure 
correspond to the processing periods. Each processing 
period has a duration of approximately 90 ms on the 
average with a standard deviation of 15 ms. In ad- 
dition, slightly over half of the textual information 
requires only one processing period while the re- 
mainder is processed in two periods. (The small peak 
at 350 ms is thought to be an artifact due to the way 
in which the scanning time was measured.) Apparently 
only two processing periods at most are needed, and 
this came as a surprise. Another surprise was the 
50 ms dead time before information appears to be 
processed. You may remember that the same result was 
found in the constant-rate visual measurements 
(Figure 5), but to also find it in the free-rate tac- 
tile measurements was beyond expectations. One more 
numerical result can be compared. The mean value of 
the single-window-width probability density function 
is 140.89 ms--very close to the 141.1 ms measured 
value. 

The Effects of Tracking 

This model describes the mental information pro- 
cessing mechanism involved in reading, but if we are 
to fully describe free-rate reading we also need a 
description of the additional task of tracking. In 
1970, Franco Bertora, who was working on the Optacon 
project at Stanford University, ran an experiment 
which gave a measure of the effect of the tracking 
task (7). Bertora programmed a computer to produce 
a visual display which In many respects was similar 
to those used in the previously described constant- 
rate visual experiments. In addition he built a 
tracking device modeled after an Optacon camera. 
This device provided X-Y signals to the computer so 
that the svbjects could control the displayed image. 
As the tracking probe was moved, the image moved in 
synchrony. Thus, the display was a visial analogy to 
an Optacon. 

Bertora varied the window width, and measured the 
reading speeds of five well-trained sighted subjects. 
His results are shown in Figure 8 as black dots for 
each of the three window widths he measured. When he 
tried to fit his data with the constant-rate equation 
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FIGURE 8. DATA MEASURED AND EQUATION DERIVED BY 
BERTORA (5) FOR A FREE-RATE VISUAL 
READING EXPERIMENT DESIGNED TO MEASURE 
THE EFFECT OF THE TRACKING TASK. Average 
for five subjects. 



= peiception and processing time (sec) 
= tracking constant (sec/i^s). 

This equation results from an assumption that, in 
free-rate reading, the time needed to process the 
information in each window width of distance along a 
line of text is made up of two parts: the textual 
information processing time and the tracking infor- 
mation processing time. Furthermore, it is assumed 
that the average tracking time for a line of text is 
only a function of the reader, the text material and 
the tracking system (eye, arm and hand, etc.). Thus, 
as the window width increases, the amount of time 
spent on tracking will also increase in proportion. 



(2) 



From his data, Bertora determined that the 
values 



he found very poor agreement, however I suggested 
that he try an equation of the form 



" t + W T 



(3) 



t = 95 ms 
P 

= 28 ms/Zs 

would give a curve that fit his data (see Figure 8). 
However, 1 find that 



where 



S = reading (scanning) speed (&s/sec) 
r 

W = window width (is) 



t = 92 ms 
P 

= 31 ms/As 

give an even better fit (dashed line in Figure 8). 



o 

ERIC 



129 



By finding that it takes about 30 ms on the 
average to process the tracking information contained 
in each letterspace of distance along a line of text 
when the tracking is done manually^ v.e have deter- 
mined the effect that this tracking task has on free- 
rate reading. Since the processor is time-shared^ 
the time spent processing the tracking information 
must reduce the available processing time for textual 
information. Thus for manual tracking and a 1*0 is 
window width, one out of every four processing periods 
is devoted to the processing of tracking information; 
for a 3.0 is window width the ratio is one out of 
every two periods. 

It is expected that for other tracking systems, 
the ti'acking constant will have other values. For 
instance, for normal visual reading the eye is the 
tracking system, it can be moved quite rapidly nnd 
few muscles are involved in producing the motion, 
For this system the tracking constant may be as small 
as 10 ms. 




DiSPL/iY TIME tmsl 

FIGURE 9. COMPARISON BETWEEN THE PERFORMANCE 

CURVE FROM FIGURE 5 AND THE PREDICTED 
PERFORMANCE CURVE DERIVED FROM THE 
RESULTS OF BERTORA AND THE MENTAL 
PROCESSING MODEL - 



Using the Reading Model 

We now have a good model of the free-rate reading 
process. One of the most important aspects of any 
model is its ability to predict performance, and this 
model does quite well in that department. By using 
the probability density functions for each word 
length (Figure 6), Equation (2), and Zipf's law (8) 

P(n) = C/n, C = 0. 1 , 

u predicted version of the performance curve measured 
in the constant-rate visual experiments (Figure 5) 
can be found. This predicted curve is shown in 
Figure 9 along with the measured data. As can be 
seen the agreement is quite good. 

Since the model indicates that only the processinf? 
of information is important and not the spacing, it 
would predict that the effect of changes in inter- 
letter spacing would be negligible over a wide range 
of values. An experiment was run with a constant- 
?*ate tactile display in which the amount of space be- 
tween the letters was varied. The subjects read con- 
nected English prose at two different display rates. 
Figure 10 shows the results of that experiment. The 
vertical bars at each data point indicate plus and 
minus one standard deviation; the theoretical curves 
were generated from the model. Again the agreement 
between the theoretical and the measured results is 
good. 

What, then, does the model predict for the effect 
of window width changes on Optacon reading performance. 
Figure 11 shows the reading speeds that we would ex- 
pect to measure if th<=s Optacon window width could be 
varied from 0 to 7 is* The constant-rate reading rate 
would increase linearly out to around 5 to 7 As, where 
the limited short-term memory capacity (3, 9, 10), 
which acts like an internal window width restriction, 
would in turn limit the reading rate. Free-rate 
reading speeds, on the other hand, do not increase 
linearly. Free-rate reading is faster for small 
window widths due to ones ability to tailor his 
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FIGURE 10. THE EFFECT OF INTERLETTER SPACING— 
BOTH MEASURED AND THEORETICAL FOR 
TWO DIFFERENT DISPLAY RATES. 



scanning speed to his processing requirements. At 
window widths above 2 is, free-rate reading is 
slower due to the added tracking task. Since the 
Optacon is used for free-rate reading, we see that 
doubling the Optacon window width will not double 
the reading speed. However, it will increase the 
reading speed to a much more useful value. 

It must be kept in mind that these results only 
apply to eventual performance levels, and long-term 
learning effects can become a problem in experiments 
designed to verify these predictions. As an example, 
about a year ago I ran an experiment designed to 
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FIGURE 11. EXPECTED TACTILE READING SPEEDS FOR 
BOTH Ti-IE CONSTANT-RATE CASE AND THE 
FREE-RATE CASE. 



Window width. However, after the training period, 
the wide-window display was just as good as the 
normal Optacon display but no better. Because of 
scheduling problems and school, the experiment had 
to be terminated. Thus we still do not know whether 
the subjects would have continued to learn so that 
their wide-window reading speed became faster than 
their normal-Optacon-display reading speed; or 
whether there is some, as yet, unknown limitation 
which prevents them from reading any faster. Hope- 
fully, longer experiments will allow us to find the 
answer. 

Conclusion 

We now have a theory for reading textual ma- 
terial which can predict, at leaist some, reading 
data, but like all theories it must be proven. Be- 
cause of the learning problem, it will take time and 
be difficult. I expect the way will be bumpy, but, 
at least, I have confidence that we are on the right 
road. 



test whether or not blind subjects proficient in 
Optacon reading could learn to read with a 1.5 ^s 
tactile constant-rate display. We hoped that they 
would learn to utilize the additional information to 
produce an increase in their reading speed. Figure 
12 shows the average results of that experiment. 
Their performance, as a function of window width, 
was periodically measured during 2 months oJ' 1.5 is 
training at 2-3 hours per week. The first and last 
performance curves are shown with the expected result 
which was calculated using the model and the subjects' 
individual Optacon reading performance curves. No- 
tice that initially the extra information, contained 
in the wider display, confused them and their per- 
formance actually decreased with, an incj'ease in 
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FIGUflE 12. RESULTS FROM A SHORT TACTILE EXPERIMENT 
DESIGNED TO DETERMINE WHETHER A 1.5 Cs 
WINDOW INCREASES THE READING SPEED AS 
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NEW PROMISES IN READING BY LISTENING 



by 

Prsincis P. Lee, Ph.D. 

Lexicon, Inc . 
60 Turner Street 
Valtham. Mass. 0215^ 



Speech and writing are two forms of* hu- 
man communicatioJi . It is safe to say that 
speech comes before writing, for there are 
still many primitive peoples in this world 
who do not yet have written form of their 
spoken language. While writing can closely 
represent speech in the essential semantical 
sense, we must recognize that speech and 
writing each has its own distinct attributes. 

Speech is produced in real-time . The 
speaker "composes" the message as he speaks. 
He may, of course, pause from time to time 
to search for the right words which best con- 
vey his idea. He raises and lowers his 
voice, speeds up and slows down to give the 
speech just the right shade of meaning he 



wishes to impart. His voice, to those who 
know, can easily be recognized as his. Un- 
der many circumstances, he may add gestures 
to help him communicate. From a listener's 
point of view he accepts the message in 
real-time as it happens. 



With recordings of human speech, we no 
longer have to accept the message as it is 
originally produced. With easy to use and 
reasonably priced cassette tape recorders 
now available everywhere, tape recorded 
speech has become a very popular medium of 
information exchange , To the visually hand- 
icapped it is an alternative or a supplement 
to Braille. To the general public, it saves 
the cost and time in putting the message in 
written form. The listener , while listen- 
ing to a recording being played back, caji 
still use his visual channel for performing 
other tasks. Yet, because it is a speech 
recording, the listener is essentially paced 
by the original rate of production. Any 
attempt on his part to alter the tape speed 
by an appreciable extent affects the quality 
of the sound and its intelligibility. We are 
all familiar with the fact that when we speed 
up a recording we get tlie Donald Duck-like 
sound, and when we slow down a recording we 
get an unpleasant growl. 



On the other hand, language in written 
or printed form takes much longer time to 
produce than to receive. Time is taken to 
revise and re-revise the script, to set the 
type, to check the galley proof and to print. 
To segment and link his ideas the writer has 
only the use of the punctuation mai'^ks, the 
grouping of sentences into paragraphs and 
the grouping of paragraphs into chapters . 
For the reader, he can read the material at 
a place, at a time and at a rate of his own 
choice . He can skimp or scan over some 
parts, and dwell slowly over others. Print- 
ed material can be produced and reproduced 
at extremely low cost. 



How can we provide for the listeners 
of recorded speech the freedom of controlling 
his own listening pace? We know, from our 
experience, recorded lectures, for example, 
are in general too slow for the average lis- 
tener; hence, we wish to speed them up. We 
also know that when the recording is noisy 
or has several simultaneous voices , a slow- 
ing down of the playing speed can enhance 
comprehension . Therefore , we want to have 
the freedom to control the listening rate in 
both directions at listening time* What we 
want is a speech time compressor-expander 
machine . 
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Speech time compression-expansion is not 
new. In 1959t Fairbanks, Everitt and Jaeger 
were issued a U.S. patent on a machine which 
produces a normal sounding output tape from 
a tape played at higher than normal or lover 
than normal tape speed(l). The technique used 
was discarding or inserting periodically seg- 
ments of speech of durations in the order of 
10 to 80 milliseconds. 

The basic mechanism used is a rotating 
magnetic head assembly with four matched 
heads spaced 90 degrees apart . The tape wraps 
around the rotating ma^^netic head assembly 
for 90 degrees. For example, in compression, 
the head assembly rotates in the same direction 
tion of tape motion. The relative speed of 
the tape with respect to a head when it is 
in contact with the tape is maintained at the 
recording tape speed. Since the tape-to-head 
relative speed is unchanged, the sound spec- 
trum remains also unchanged. But when one 
head leaves and a second head comes into the 
contact zone, the segment of tape wrapped 
around the head assembly will not be scanned 
by either head and will be effectively dis- 
carded. The figure below illustrates the 
relationship of the tape and the head assem- 
bly at two instants of time. 



TAPE 



TAP 



TAPi 



ROTATING HEAD 
ASSEMBLY WITH 
ONE HEAD IN 
CONTACT WITH 
TAPE 



ROTATING HEAD. 
ASSEMBLY WITH 
TWO HE^TDS IN 
CHANGE-OVER 
POSITION 



Speech compressor- expanders employing rotat- 
ing magnetic heads have been commercially 
produced in Europe and this country (2). The 
cost, size and maintenance required put the 
machine out of reach of individuals. 

To xinderstand why the sampling method in- 
troduced by Fairbanks and his colleagues 
works, we have to look at the linguistic and 
phonological side of speech. 



Speech is made up from sound elements 
which the linquistics call phonemes. There 
are consonant phonemes such as the "kuli" 
sound in "cat" , and vowel phonemes such as 
the "ah" sound in "father". Since phonemes 
are produced one after another in a complex 
overlapping manner, it is not possible to 
isolate them, although it is not too diffi- 
cult to determine the effective phoneme du- 
rations. The phoneme duration varies from 

tens of milliseconds for some consonants to 

(3) 

hundreds of milliseconds for vowels. ' Suc- 
cessful speech time compression has been 
achieved when segments of speech of a frac- 
tion of minimum phoneme duration are deleted, 
and successful speecli time expansion has been 
achieved when such segments of speech are re- 
peated. The quality of the rate-altered 
speech depends on the care of joining the 
segments together and the smoothing done to 
the joints. 

Speech consists of more than segmental 
phonemes. On the phrase and sentence level 
there are the stress, intonation and rhythm 
we find so important. 

Stress and intonation are carried on three 
acoustic parameters, namely, voice pitch, 
^owel sound duration and intensity. Selec« 
tively shortening vowel duration, while a 
possible way of achieving speech time com- 
pression, would upset the stress and intona- 
tion pattern. 

How about pauses? Can we eliminate the 
pauses to achieve speech time compression? 
The answer to this question depends on what 
kind of pause it is. Obviously, the very 
long pauses during which the speaker has 
nothing to say and the listener is not ex- 
pected to think can be completely eliminated. 
Short pauses of duration of less than one 
half second are usually either hesitation 
pauses or juncture pauses. Hesitation 
pauses are used by most speakers to search in 
his mind for the most suitable words or phra- 
ses. From a listener's point of view it can 
be eliminated. Juncture pauses, on the other 
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hand, are placed at phrase and sentence boun- 
daries to serve as pmictuation . Both the 
speakey and the listener need the juncture 
pause time to mentally process the informa- 
tion. If jmicture pauses are eliminated, the 
listener, vhile hearing every word of the 
speech, can miss a lot of the meaning because 
he may not have enough time to digest the 
overflowing information. Unfortunately, 
hesitation pauses and Juncture pauses span 
about the same range of duration and there 
is no way to selectively delete one kind and 
not the other; Deletion of pauses longer 
than about one half second in duration is an 
effective way to compress speech tape re- 
cordings, unless such long pauses are delib- 
erately placed for listener interaction. A 
twenty-four hour telephone wire-tapping re- 
cording, for example, can be greatly bene- 
fited from the use of long pause deletion 
technique . 

In conclusion, I would like to demon- 
strate the Varispeoch-I, an electronic speech 
time-coinpressor/expander which is manufac- 
tured by Lexicon, Incorporated. It is rea- 
sonably compact, easy to operate aJid , thanks 



to the elimination of rotating heads, very 
reliable . Ve hope , after hearing the demon- 
strati.on, you can form an opinion of your 
own whether it brings some new promises in 
reading by listening. 
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(A recording of the above mentioned demonstration 
is available from the author, Ed.) 
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I10BILE PLATFORM FOR THE PARAPLEGIC 



by 

Clair L. Wyatt 
Dean J. Shaffer 
Donald R. Rasmussen 
Electro-Dynamics Laboratories 
Utah State University 

Suirmary . The objective of this research program was to develop a 
low cost mobile platform to provide for human needs In three cate- 
gories: (1) to increase the independence and freedom of movement 
of the paraplegic who resides at home and who may be capable of 
rehabilitation; (2) to facilitate the movement, with the aid of 
nursing-home personnel or of relatives at home, of aged persons for 
whom mobility is difficult; (3) to facilitate the movement of per- 
sons in hospitals between surgery, intensive care, and convales- 
cence departments. 

The objective of this program was achieved as a result of 
effort in the following areas; 

(1} An investigation was conducted to ascertain the most 
important physical needs with regard to problems of mobility of a 
broad range of handicapped persons. 

(2) A market study was made of available wheelchairs to 
determine the versatility and cost, 

(3) The existing equipment was evaluated in terms of the 
most important physical needs of the paraplegic and a criterion 
was formulated for a systems development program. 

(4) A functional design was produced for a mobile platform 
which incorporates multiple features to satisfy to a degree and 
at low cost the most important physical needs of the paraplegic. 

(5) Two prototype mobile platforms were designed and fabri- 
cated to demonstrate the feasibility of the functional design. 

(6) The prototype was evaluated by handicapped persons 
leading to recommendations for future development. 



Introduction 

It has been estimated that there are from 
60,000 to 100,000 Americans who have spinal cord 
injuries with new cases per year of 4,500 to 
10,000.* Paralysis of the lower part of the body is 
called paraplegia while quadviplegia is paralysis of 
both arms and legs. These spinal injuries result 
from physical accidents, such as automobile acci- 
dents, and disease. Multiple sclerosis, cancer, 
tumors of the spinal cord and other neurologic dis- 
orders frequently result in spinal injury. 

Paraplegia 'may typically cost upwards from 
$15,000 for the first hospitalization followed by a 
lifetime of treatment and checkups. The needs of a 
paraplegic include: adaption, the physiological and 



* Spinal Cord Injury - Hope Through Research, U.S. 
Department of Health, Education, and Welfare, 
Public Health Service, 1969. 



philosophical acceptance of the fact of the condi- 
tions, and stability, the development and mainte- 
nance of a continued productive life thereafter. 

Immobility due to aging affects millions of 
our senior citizens. Frequently* these persons 
must be placed under professional care in a "rest 
home." It is well known that in many cases the aged 
person could remain in his own home except for great 
difficulties associated with his physical movement 
and handling, and that many in rest homes are neg- 
lected and confined to the bed only to degenerate 
physically and mentally because of the same mobility 
problems. A similar situation exists with amputees. 

Many of the handicapped, young or old, find 
themselves dependent upon the solicitude of others 
for the perfomance of simple functions of main- 
taining adequate body hygiene, and must wait for 
physically strong persons to "man-handle" them from 
bed to chair and back. Frequent movement .or adjust- 
ment in position is necessary to prevent the for- 
mation of decubitus ulcers ("bed sores"). . 

1 
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Figure 1 The canti levered platform 




Figure 2a Platform-to-bed transfer 




Figure 2b Platform-to-bed transfer 



The equipment corranercially available for the 
use of immobilized persons is so limited that few 
are able to realize an appreciable degree of inde- 
pendence and mobility. These limitations are as 
follows: , 

(1) The cost of specialized medical equip- 
ment is disproportionately high in comparison with 
other nonmedical but equally complicated equipment. 
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Figure 2c Platform-to-bed transfer 




Figure 2d Platform -to-bed transfer 



(2) The cost is very high compared with the 
users ability to pay. Most handicapped persons 
have no source of income, and state rehabilitation 
money is available only on a limited basis. 

(3) Presently available equipment is not an 
intrinsic aid to the handicapped person, but 
rather is an aid to a second party in the handling 
of a paraplegic. 

(4) The presently available equipment is so 
specialized that it generally provides only a 
single function. This is illustrated in the case 
of a wheelchair which provides little or no means 
for removing the* patient from the bed to the chair. 

(5) Another important economic aspect is that 
overall costs to the patient are minimized when he 
or she can administer their own needs through the 
aid of prosthetic equipment such as the mobile 
platform. 

Important Physical Needs 

The needs of the paraplegic have been investi- 
gated by interviewing both handicapped persons and 
those who treat and provide aid for them. Inter- 
views were held with personnel of the department of 
Physical Medicine and Rehabilitation at the Univer- 
sity of Utah Medical Center, of the office of Re- 
habilitation Services, Utah State Board of Educa- 
tion, and of the Independent Living Project, Logan, 
Utah. Interviews have also been held with members 
of the "Frontier Club" of Utah which includes per- 
sons with a variety of spinal injuries. 
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Figure 3a Platform-to-automobile transfer 




Figure 3b Platform-to-automobile transfer 



1 . In and Out of Bed 

The initial problem for any person who is 
immobilized is the transfer from bed to a wheel- 
chair or other mobile platform and back. In many 
cases this is accomplished by simple brute force. 
One or more strong persons literally pick up the 
patient to move him or her about. This complete 
dependency upon the solicitude of others is very 
demoralizing. For many, especially the aged, 
such help is often not available and they remain 
in bed. 

"Patient lifters" that utilize a sling are 
commercially available to transfer a person from 
the bed to a chair. However, a sling will not 
adequately support a person who lacks muscular 
control; therefore, several persons are often re- 
quired to effect a transfer. 

These observations lead to the conclusion 
that a paraplegically handicapped individual needs, 
a mobile platform that includes means to accomplish 
the transfer with a minimum of assistance. 

O 
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2. Powered Motion and Position 

Both position change (lifting and reclining) 
and translational motion must be powered by some 
nonhuman energy source. Such a source, in the 
absence of human locomotion, can provide energy for 
motion. 

The automobile battery provides a relatively 
inexpensive and compact source of energy of suffi- 
cient capacity to last between overnight recharges; 
therefore, electrical motors can provide for motion 
and position change and are adaptable to control 
by simple means. 

3. Recline 

The third problem is related to the discom- 
forts associated with remaining fixed in one posi- 
tion for an extended time. Whether in bed or in a 
chair, the lack of movement and position change 
leads to swollen feet [dependent edema) y bed sores, 
and other discomforts. A mobile platform should, 
therefore, be provided with a reclining seat so 
thel feet can be raised or the person can rest in a 
supine position at will. 

4. Car Entry 

The logical extension to independence and 
mobility achieved by satisfying the needs described 
so far, is to extend these functions beyond the 
home. Means need to be provided to facilitate entry 
to land egress from an automobile. 



5. Portability 

It is desirable that the mobile platform be 
conveyable in an automobile in order to extend 
mobility beyond the car. Portability, or the 
ability to collapse the chair and place it in the 
trunk of a car or the rear of a station wagon is 
the most attractive approach because it does not 
require a special automobile or modifications to an 
automobile. 



6. Negotiate Steps or Curbs 

Entering or leaving some buildings often 
requires equipment with the capability of nego- 
tiating steps. This is a most difficult problem 
that may not have a practical solution at the 
present time. 

7. Cost 

Finally, those who most need such aids are 
generally the least able to afford them. State 
rehabilitation funds are usually available only on 
a very limited basis. Therefore, every design de- 
tail should be considered in terms of manufacturing 
cost. It is probable that a great many designs 
could satisfy the engineering requirements, but the 
cost must dictate which design is used. 

The desired goal is to design a machine that 
can achieve success in the marketplace. To do this 
the price should be less than about 20 percent of 
the average annual wage or about $1,000 for a 
mobile platform with many of the features listed 
above. 
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8. General 

There are also physiological needs of the 
patient in addition to those classified above. The 
mobile platform should not look like a "Rube Gold- 
berg" contraption which may frighten an already 
apprehensive patient. It should be stable and 
simple in appearance, and essentially foolproof. 
The mobile platform must be safe, 

Market Study 

The wheelchair was emphasized in this study 
since the wheelchair mechanism has been used with 
great benefit for many years as a mobile platform 
and satisfies some of the needs outlined above. 

Commercial equipment typical of that which 
can be purchased on the market has been surveyed. 
The Utah State Rehabilitation Office was very help- 
ful in this regard. The resulting information from 
the various sources is given in Table I, where each 
manufacturer is listed along with the cost (1968-69) 
of typical' wheelchair models. For each, the sig- 
nificant functional aspect of the chair is indi- 
cated. 

Conclusions 

(1) The cost is very high in proportion to 
other equipment of equal complication such as a 
bicycle or motorcycle, for example. The cost is 
also high compared with the users ability to pay or 
with rehabilitation funds which may be available. 

<2) None of the commercially available wheel- 
chairs surveyed provides significant features to 
aid in the transfer from bed to chair, the first 
step to rehabilitation. Generally, any one chair 
design provides only two or three features. 

This study demonstrates the need for a new, 
unique approach to the design of a mobile platform 
to achieve the goals cited above. 

Functional Design 

A functional design of a mobile platform was 
developed which incorporated multiple features to 
satisfy the needs out Lined above. 




Figure 4a Normal sitting or running mode 
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Figure 4c Reverse sitting or running mode 




Figure 4d Kitchen sink work mode 



TABLE I WHEELCHAIRS 



Name or 
Manufacturer 


Bed to 
Chair 
Transfer 


Height 
Adjustment 


Recline to 
Supine 
Position 


Powered 
Position 


Motion 
Powered 


Stair 

CI imb 


Portabtlity 


Cost* 


Everest and 
Jennings 
(USA) (p. 139 
Preston) 


No 


No 


No 


No 


Yes 


No 


No 


$529.00 


Everest and 
Jennings 
(USA) (p. 136 
Preston) 


No 


No 


Yes 


No 


No 


No 


Yes 


$289.00 

to 
$366.00 


Fa 1 con 

Research and 
Developipenc 
(Denver, 
Colorado) 


No 


No 


Yes 


Yes 


Yes 


No 


No 


$2,450.00 


Applied 
Scientific 
Knowledge. 
Inc. (Lincoln, 
fie bras ka) 


NO 


No 


Yes 


Yes 


No 


No 


No 


$1 ,695.00 


• ccnni ta i 
Aids for the 
Handicapped 
(Sweden) 
"Permobll" 


No 


Ves 


Ho 


Ves 


Yes 


Yes 


No 


$4,500.00 


American 
Wheelchair 
(Cincinnati , 
Ohio) 


No 


No 


Yes 


No 


No 


No 


Yes 





* The prices are catalog listed for 1968-69. 



An engineering feature used in a functional 
design Is the principle of the cantilever. The 
cantilever is a structure which is anchored on one 
end and is completely free on the other end. This 
principle is used by supporting the platform above 
the frame on a single column (see Figure 1). The 
platform is therefore free of any support struc- 
ture on either side and both ends. This design 
permits the patient to be moved directly over and 
then lowered onto the bed. This movement is 
analogous to a conventional fork lift which can 
lift a load and deposit it on an elevated platform. 

The design also included the capability to 
convert from the horizontal platform of Figure 1 
to a more conventional seat, be raised or lowered 
by a linear extension of the support column, and 
be rotated with respect to the frame. A method of 
platform-to-bed transfer is then possible where the 
seat reclines to a horizontal platform and is 
raised above the level of the bed, as illustrated 
in Figure 2a through 2d. 

This method of transfer can be accomplished 
without the need to physically lift the patient. 
Very little physical effort is required to roll or 
perhaps slide a person over onto the bed. A para- 
plegic with some upper ability could effect 
platform-to-bed transfer without any outside aid. 

The bed-to-platform transfer described above 
requires the features of cantilever, recline, ro- 
tation, and height control. These features are 
achieved in an extremely simple and uncluttered 
way through the use of a support column containing 
a Saginaw Linear Activator and a simple lever mech- 
anism. When the linear activator is elongated, the 
lever mechanism automatically reclines the seat. 
The activator also permits rotational freedom of 
movement. The seat achieves full recline to the 
horizontal position at the same instant that max- 
imum height is obtained. After being rotated one- 
quarter turn a locking pin is disengaged permitting 
the platform to be lowered onto the bed and to 
remain in the horizontal position. 
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Figure 5a Platform-to-bed demonstration 




Figure 5b Platform-to-bed demonstration 



The features described above provide other 
useful applications: 

(1) The seat can be reversed one-half turn 
and driven with the small wheels forward. 

(2) The patient can be placed level with and 
adjacent to a bathtub. 

(3) The seat can be oriented at any con- 
venient angle with respect to the frame to effect 
a platform-to-automobile transfer. With the arm- 
rest removed on tlie auto side, the passenger can 
be slid onto the car seat (see Figures 3a and 3b). 

(4) The seat can be placed in a recline posi- 
tion providing a profile height of less than 
twenty-eight inches. In this position the chair 
can be placed in the rear area and conveyed in a 
standard station wagon. 

The seat is locked in place with respect to 
the wheels and frame when in the sitting position 
to prevent undesirable seat rotation during trans- 
lational motion. Either of the legs can be locked 
up In the extended position, for patients wearing 
casts, independently of the other chair functions. 

The power drive system uses conventional wheel- 
chair motors, but the coupn'ng is accomplished 
through the use of bicycle chain and sprockets. 
The wheels are standard twenty- inch cart wheels 
with slick balloon tires. The electrical control 
system is of the conventional joy-stick which 
activates micro-switches. 

Demonstration 

The second prototype model mobile platform was 
field-tested by Clyde and Pat Braegger of Provi- 
dence, Utah. Mr. Clyde Braegger is a polio para- 
plegic and Mrs. Pat Braegger is a polio quadra- 
plegic with some hand and arm control. This mar- 
ried couple, who have participated conceptually as 
well in this development, permitted pictures to be 
taken while they demonstrated the use of the 
chair. 

Figures 4a through 4d illustrate the mobile 
platform in the normal, reclined, reverse, and work 
mode. 

Figures 5a through 5c illustrate the platform- 
to-bed transfer. 

Figures 6a through &j Illustrate platform- to- 
automobile transfer. 

Figure 7 illustrates stowage of the mobile 
platform in a ford Fairlane station wagon. 

In each of these transfers Mr. Braegger was 
able to supply all the aid needed to effect the 
maneuvers of both himself and his wife as illus- 
trated. With this mobile platform they could inde- 
pendently attend to the normal activities in the 
home as well as extend their mobility beyond the 
home. 

Conclusions 

The result of this research has been the 
development of a mobile platform for the handi- 
capped that incorporates several unique ideas that 
enables a person with paraplegia to achieve a great 




Figure 5c Platform-to-bed demonstration 




Figure 6b Platform- to-automobile demonstration 
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Figure 7 Platform stowage in station wagon 



degree of independence and mobility. The following 
conclusions are drawn: 



(1) Bed- to- platform and reverse transfer has 
been achieved without the requirement to call upon 
other persons. 

(2) Continuous recline to the full supine 
position has been achieved with power control to 
permit a patient to change position or to rest in 
the supine position. 

(3) Car entry and portability have been 
achieved through the freedom of height and rota- 
tional position adjustment of the seat with re- 
spect to the wheels and frame. 

(4) Difficult maneuvers of approach to the 
bathtub have been facilitated by the same freedoms 
of motion of the seat with respect to the wheels 
and frame. 

(5) The estimated cost to reproduce the 
mobile platform is less than $1,000. 
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7n^ro(!ii^ct ion 

/M'V, ^'hoso roluil-ilitatinn contor is this 
yonr conmcroratinr i tft K-ilvcr nnniverRarv and 
v'hicli nov: functions in cooncrntion vnth t)\o 
ncv/lv fonnc'<l Interna Li onaj 5'crvice« for the* 
VJind has continued a roscarcb nrorrfiin for noro 
tliiiu a tlecaUo. Tlic evaluation of the ""inaiiral 
fcnsor is bcinp conducted as one of tlic sc^rics 
of studios involving' nino otlier afrfncirs funded 
hy rovcrrw!fM\t and private sources . The nroicct 
soel'.s to dctcrTRiiie tho potential benefits to 
Fjohility of this sensory aid in conjunction 
v.n til the cane nethod of trave] (in sono afoncies 
in con.i unction vith the use of f»uide dor.fj) nnd 
to see if any psycholonical factors such as 
self confidence are. in anvv^av n3tered hofore 
and after tlie use of the device. 

Description of the Device 

The sonic instrument is encased in a pair 
of heavy eye rla^?^ frames v;lth the opening for 
tlie ultffionic cinmissions heinp placed hetv.'een 
tlie lenses .lust above the hrid;»e of tlic nose. 
Ad.iacent to this are tvo neshed openin,r\s^ one 
facinfT slightly to the left and one slir.htly to 
the ripht of center, to receive had: tlie ultra- 
sonic impulses after they have rel>ounded from 
an oh.iect in the environment. 

Or- Leslie Kay, the developer of the in- 
strument In V.e\-7 I'ealand described the purpose 
of the device as follows: "The aim is to pro* 
duce the sensation that objects v;ithin a Xv»ide 
cone emanatinj', from the forehead appear to niahe 
their ov;n characteristic sounds. They would 
then he perceived in ruch the sai^e vav that ve 
normally hear sound eiiianatinj> from ob.iects such 
as a hunc)^ of T^eys beinp shaken or leaves 
rustlinp, in the trees." 

. ?ihe ultrasonic sounds after houncinp back 
from objects are translated into audible sounds 
vjhich are channelled binaurally into each ear 
through small plastic tubes attached to the 
spectacle temples. These tubes arc constructed 
so there Is no obstruction of tlie ear canal, so 
that outside sounds such as car noises, foot- 
steps or people speakinp are in no vjav inter- 
fered vith. 



Major I'oblll.tv Airs 

The sounds produced by the ultrasonic 
impulses rcboundlnf^ from obi«3cts and channelled 
into the ear are diverse in relationship to 
surface texture, distance and size, The ques 
tion that arises is this: Can a person usinp 
the device sufficiently differentiate the 
nultitude of sounds received to determine 
significant objects in his environrent, Could 
he also determine them soon onouph in relation- 
ship to his ovm location to aid him in either 
reaching, them or avoiding then depending on his 
purpose. In theory the device offers an exten-- 
sion of the vearer's av/nreness to as much as a 
radius of fifteen feet. Can this a\;areness 
enable the \?earer to become a more efficient 
traveler involving shorter tiir.c durations, 
fewer errors in detecting hazards, makinct turns, 
recor*nizlnp, landmarks and in j^eneral moving 
iporc freely throu;ili the environment, 

Fubjiects for the J^tudy 

All tlie subjects currently beinp tested by 
this a^^cncy are experienced adult cane travel- 
ers, V-ith fe^: exceptions, all are living in 
and around the city of hit tie ^.ock, Most of 
them liave nscd the cane tecfinique over a period 
of years. The Ultrasonic I'inaural f^cnsor is 
intended to supplement their use of the cane 
techninue, not to serve as a replacen^ent , 
Local residence facilitates lonp ranr.e follo\'up 
at minimnl co5?t. 

Since each person is an experienced travel 
or, it is possible to determine throufji environ 
mental tests the de/»ree of mobility acldcved 
already without the use of the device, All the 
subjects are volunteers, many of whom work for 
ap.encles se.rvinfr the Mind lncludin?». the school 
tlie state reliabilitation service, and the pri- 
vate apency . 

ProcfMlure 

Initially each sul'^joct receives a !\rarinf^ 
test so that liis ability to perce e sound in- 
put from the device in all t)ifir fronuoncies 
can be determined. 
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Tn order to nccustom the siibiocC Co Cbn 
nm.' types of sounds nnterine tho ear cnnnl nn<! 
to nnl o the sound distinct fron: trhe <?onr»rnl cn- 
vironnont, n typo of 'artlflcnl onvi ronr.nnt' 1s 
di^vnloned. Tbin in ncbievnd ^.'ltb tlie use of 
poIgs one incb In diameter and seven feet lonr 
T'itb t-Teir:bted bases v»blcb mav]>G easily placed 
to stand in a variety of positions in a clear 
place s\ich as a la»'n or larpe coiirtvard area 
without other obstructions vltbin at least a 
30 foot arna. A pole is placed for the subiect 
to identify solely by its sound. After be has 
accustomed blmself to locating and .mnroacbinr. 
tlie slnt»l.c pole, a second one is addrd and tlien 
a third, and so on. 

I'sinp those and additional polns the sub- 
ject »'lll learn to move amonp thnm as T.'ell as 
to picl* them up and carry tber^ and place tbon 
In arran.p,enents of various pcorotric configur- 
ations. In such a vay as this be becomns 
accustomed to associating his ov»n sense of 
mo* ewent and tho touch of ob.iects in his envi- 
ronment »'»lth the nevr sounds be Is perceiving. 

The closer an object is to a subject, the 
lov^nr the pitch and the louder the sound be- 
comes. The flatter the surface of the ob'^ect, 
tlie r.ore uniform Is the quality of the sound 
(as with a brick vail) the more diverse the 
reflectlni^ surfaces of the object (as with a 
bush with many leaves) the more the qualltv of 




John Clapp (right) , a teacher in the use of the 
Ultrasonic Benaural Sensor at Arkansas Enterprises 
for the Blind, helps a subject locate an obstacle 
using the combined sonic and cone technique , He is 
wearing earphones that are attached to her device 
so that he receives the same input that she does, 
thus he can help her interpret sounds » 
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the sound becomes diverse (described by sub- 
jects as ' svd.shinp sounds'). 

The subject then beplns to explore a simple 
training? environment locating such common ob- 
iects as vTalls, bushes, la^-ms, walk^-^ys, trees, 
bedpes and even the instructor standing in one 
position in an outside environment, as he be- 
comes proficient in identifvinp these basicallv 
isolated objects . 

The subject then extends his tralninfr into 
residential areas, bojUnninr. to identify by 
their sounds, the various crosst'a 1 ks , pates, 
fences, curbs, bushes, trees, etc. 

In theory, the subject vill need to focus 
his attention increasinplv less on the sounds 
that he hears, responding to the various input 
si;»nals as a sip,hte(j person mlftht to , objects i n 
his peripheral vision. \^en one tone out of 
the medley catches his attention as beinp os~ 
peclallv significant he can focus oNi it deter- 
mininp vrhetber -or not It is an obstacle or 
hindrance to be avoided. 

Testinp mobility proficiency in cane travel 
is traditionally subjective on the part of the 
user and the instructor-- can a person pet from 
one place to another: can he avoid injuring 
him.self alonp the way: can he do it in a rea- 
sonable amount. of time; and does he disnlay 
a certain amount of confidence while doinp it. 
To reduce these Peneral questions to mea^^urable 
standards a blend of subjective analysis with 
objective components are beinp used. 

Testing areas have been laid out two in 
residential areas and tvro in the dov^ntown 
area. Prior to usinp the sensors, each 
subject is followed throuph two of the testlnp 
areas. The. number of obstacles he can nick up 
alonfT the wav such as curbs, trees, overhanpinp 
brandies and so forth have been carefully noted 
previously. The evaiuator keeps a record of the 
wav each of those objects is nej;otiated durinp 
the travel usinp solely the cane techninues . 
The time of .nakinp the entire run is also kept. 
Following the completion of traininp with 
the binaural sensors, a similar run havinp 
basically the same number and kind of 
obstacles Is traversed with a similar record 
kept. A careful analysis is done concerninp 
the manner and effeclencv vrith' which the obstacle 
senuence was net both in the pre-test.and the 
post-test and the overall time differential. 
This is done for both the pair of residential 
runs as v:ell as the tv/o in the dovrntown area. 

)*ucb of the evaluation of the project at 
til is juncture involves an analvsls of reports 
of each subject and t{ie professional projections 
of the Instructor. A dallv account is kept bv 
I j both to determine the resnonses to the use of 
the sensor and to note anv increase in 
effeciency which the trainee may feel. 

personal Factors 

The analysis of individual traits which may 
alter with the. use of the device is measured 
throuph pre and post testinp. V7i th the 16 PF 
test. This includes measurement of traits of 
assertiveness , venturesomeness , self- 
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tlie lonp. cane. The hcnefits nost frequently 
noted include the feeling: of extending. ore\s 
environment rany feet beyond the tip of the 
lonp. cane so that certain ohstacles may be 
detected and even avoidetl without coninn into 
touch-contact v;ith tliem. This includes 
outside obstacles sucli as vails, parked cars, 
parV.inp. meters, and tre^-s , and inside obiccts 
such as those one nip.ht find alont'. tl>e aisles 
of stores. One of the rost notable benefits 
for V7hich tlie blind person has no other means 
of detection involves the avarcness provided 
by tlie device of overhanj*.inf\ objects viiich 
the subject ni.pht encounter at liead level 
whicli his cane vould never detect. 

Fince the blind traveler concentrates on 



the sounds coning- to hir normal. T\ from die 
cnvironr.ont it is important that the ailditionnl 
sounds cominp from the sensor do not distract 
him. The reports are fienerally favorable that 
the additional sounds are soon intep.rated into 
the v;hole audible spectrun and those requirinp 
attentioii can be conceiitrated on separately. 



The conclusion of this pro.iect should 
provide infon^ation necessary to ansver tlic 
questions, can som.e lOind persons benefit 
f ror.i the use of the Vltrasonic I'inaural 
Fensor as a mobility aid and ^d'.nt further 
evaluation projects should Vc undertaken in 
tlie f uture . in order to rcf i ne both the 
instrunent and its use. 
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THE. HEUGEL QUILL: A ^^£W TACTILE DEVELOPMENT FOR THE BLIND 



by 

D. Reginald Traylor 
Department of Mathematics 
University of Houston 
Houston, Texas 77004 

Summary . A new tactile writing and drawing device called 
the Heugel Quill has been developed. It offers the first 
really effective apparatus for the blind to easily write 
or draw, with an immediate tactile evaluation of the raised 
line created by the act of writing or drawing. 



Genesis of the Idea 

Several years ago, from experience with blind 
college students in mathematics classes, it became 
obvious that many blind students have talent that 
remains dormant, simply because no effective means 
exists to early recognize and then develop that 
talent. In most classes, in almost every subject 
and almost every level, some explanation is given 
which is supported by a representation that is 
graphical, geometric, or in some fashion spatially 
and visually presented. The blind student becomes 
very dependent upon word <iescripUions . Often these 
are severely inadequate, for even if the student 
offers proper words in response, the evaluation of 
his mentally held image is still far away. It was 
obvious that there is needed a more effective means 
of communicating images and ideas which are gener- 
ally presented visually. We, the blind students 
and myself, were led to explore the current state 
of technology for the blind, seeking a simple and 
effective means to convey, each to the other, vis- 
ual images so that effective evaluation might occur. 
Thus, we sought tactile representation of drawings 
which are typically visually examined. 

We were disappointed at the state of the art. 
We sought a means whereby anything which would be 
normally drawn on a chalkboard might also be easily 
and quickly presented the blind student, in raised 
line form, for his evaluation. More importantly 
perhaps, we desired an instrument which offered the 
student capability of drawing or writing, with 
raised lines resulting so that the student might be 
a participant, particularly in the sense of present- 
ing his own mental imagery for inspection and evalu- 
ation. We evaluated those tools which were adver- 
tised as drawing or writing kits, being informed 
that there did exist already effective raised line 
drawing apparatus. We were dismayed at the sorts 
of devices available. Two such devices are des- 
cribed in the Seventeenth Edition (July 1971-June 
1972) of Aids and Appliances, a publication of The 
American Foundation for the Blind: 

Raised Line Drawing Kit: A method 
whereby blind people may draw or 
write and feel the lines on the 
top surface as the lines are made. 
The kit comprises a rubber covered 
drawing board with holddown clips 
for 8V X 11" material, a ball- 
point pen filled with a colorless ^ 
lubricant, and a package of poly- 
ester film sheets which serve as 
the "paper." 

Heretofore, it has been neces- 
sary to turn the page over to feel 
the lines made with tracing wheels 
and the like, but with this new 



development, the lines can be felt 
on the top side of the page. The 
lines so made 'are quite easily fol- 
lowed by sight, 

Scri-pt Guide: This writing guide 
... is used as Che basis for a 
course in longhand writing which 
is enabling many who have never 
learned to write ordinary script to 
master this skill with minimum of 
effort. It is composed of a clip 
board which takes standard 8^" x 11" 
paper. Down the left edge of the 
board is a notched guide on which a 
carriage with a clicking device car- 
ries a 3/4" slot, formed of two 
thin metal rods. The far end of the 
slot is fitted into a metal block, 
and another such block slides on the 
rods to serve as margin stop. The 
carriage rotates on the notched guide 
so that it can be raised to simplify 
insertion of the paper- 
Additionally, sheets of tin foil were used by some, 
drawing on one side with a fairly sharp object, so 
that a raised line appeared on the other side. 
This, of course, causes a student who is already 
with some difficulty, to draw a mirror image of 
what he actually desii^es, so that the desired image 
is presented on the other side in raised line form. 

Two conclusions followed quickly. First, if 
those sorts of devices presented the best available, 
then it is no wonder that so much mental development 
of the blind never occurs. Anyone who has attempted 
to use the raised line drawing kit understands well 
its awkward limitations. We were to learn later, In 
visiting schools and centers for the blind, that 
such drawing and writing kits are often lost, having 
been discarded by the teachers as an ineffective 
tool. Next J we decided to seek federal funding. 

Seeking of Federal Assistance 

The lack of effective drawing and writing 
equipment for the blind was thoroughly investigated. 
We inquired of the Texas Commission for the Blind 
and, among others, the Arkansas Enterprises for the 
Blind. Finally, in July 1971 we attended the 
national meeting of the American Association of 
Workers for the Blind in Richmond, Virginia, seek- 
ing out those who were most knowledgeable about the 
technology available to .the blind. Being convinced 
that nothing about offered the capability we 
desired, we sought interviews with officials of 
HEW, particularly the Office of Research and Devel- 
opmnet. Bureau of Education for the Handicapped. 
We presented descriptions to them of two devices 
for which developmental funds would be requested. 
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if there were interest on their part. One of the 
devices described then amounted to a board, to be 
placed before the student, so that anyone, sighted 
or blind, might write or draw on it with an immedi- 
ate raised line, appearing in the path of the stylus. 
It would offer the feature of deforming paper or ■ 
plastic, so that the student would have "carry- 
away" record of that which transpired, as a sighted 
student might sketch drawings from the chalkboard 
for his later examination. Initial response to the 
proposed project amounted to "it can*t be done." 
However, we were about the moon effort, so we pur- 
sued that point, only to learn that "if it can be 
done, it will not be done in Texas or at the Univer- 
sity of Houston. It will be done at MIT or Stanford 
where the good people are where they do sophis- 
ticated things." (MIT has a Sensory Aids Develop- 
ment Laboratory and Stanford offered recent develop- 
ment of the Optacon.) Later, there was submitted a 
proposal to HEW, requesting developmental funds for 
the desired sophisticated drawing and writing 
device, but the proposal was negatively received 
and not funded, 

Richmond Instruments 

After much early design effort, the problem of 
actually constructing the device desired was placed 
before Robert Heugel of Richmond Instruments, in 
Richmond, Texas. Keugel had past success in build- 
ing equipment for the Apollo 16 mission (to evaluate 
eye fatigue) as well as having designed and built 
equipment for purposes of eye surgery at the Medical 
Center in Houston. Resulting was a very sophisti- 
cated piece of equipment, now called the ^Heugel 
Quill, which allows sighted and blind alike to draw 
with a stylus, on paper, with there resulting immed- 
iately behind the stylus, a raised line. Construc- 
tion time for that apparatus , which was too sophis- 
ticated to be built in Texas, was barely more than 
three months. 

Demonstration and Application 

With the prototype available, demonstration 
was made of the Heugel Quill at the Criss Cole 
Rehabilitation Center for the Blind (Austin, Texas), 
the Lighthouse for the Blind (Houston, Texas), the 
Arkansas Enterprises for the Blind (Little Rock, 
Arkansas), and most recently at the sectional meet- 
ing of the American Association of Workers for the 
Blind (San Antonio, Texas). From these demonstra- 
tions, some in actual teaching circumstances, it has 
become clear that the potential of the Heugel Quill 
exceeds that which was earlier anticipated. For 
those who need to learn handwriting skills , the 
Heugel Quill offers real means to allow the student 
to evaluate his. own effort. A college age girl at 
Criss Cole Center, upon using the Heugel Quill, was 
for the first time in her life, able to evaluate that 
which she had written in script. She was mortified, 
exclaiming, "Oh, I hope I don*t always write my name 
so poorly!" Much benefit will arise in teaching 
mobility skills. From the viewpoint of the instruc- 
tor, much time will now be preserved since prepara- 
tion of much material in raised line form can be 
accomplished with the Heugel Quill. An entire new 
mental process can be required of the student. 
After examining mock-ups of areas (made of plyboard 
or plastic) he can now be asked to roughly draw a 
map indicating the path he will take.^ His explana- 
tion now will be done with more than words, thereby 
allowing more effective evaluation. Quickly drawn 
maps are now thus available, showing obstruction 
which may have occurred overnight (such' as street 
construction, campus construction) causing new 



routes to be used. Now house plans can be sketched 
easily in raised line form, allowing the blind to 
participate more in planning a house, choosing an 
apartment, or even becoming acquainted with the 
lay-out of a new neighborhood or a grocery store. 
Development of spatial concepts is radically 
enhanced. Now the procedure, in some instances, 
is to stack many plastic or wood circles, triangles, 
squares, etc. of differing sizes before the student. 
He then identifies them, separating all common 
shapes into individual stacks. However, more than 
identification is needed and the Heugel Quill 
offers capability in that direction. The student 
can now be asked to explain his own concept by 
being allowed to draw it, evaluate it for himself , 
then offering the instructor the representation 
which the student testifies, by tactile sense, is 
his image of the concept. More communication is 
possible. A tactile laboratory setting is one 
modification, allowing Heugel Quills to all be acti- 
vated by the^drawing on anyone of them, that choice 
being made by the instructor. Now students sit 
dormant in many classes while the teacher works in 
a one-on-one situation. 

Many applications are possible. A sighted 
student will see a sketch of a nerve ending on a 
chalkboard of a biology class. This now can be 
quickly offered a blind student on a Heugel Quill, 
instead of searching for something such as a frayed 
telephone cable for his examination. Graphs in 
business courses, education courses, or psychology 
courses are immediately his on the Heugel Quill. 
He can even feel graphs of mathematical functions 
as they are being drawn, evaluating them immedi- 
ately, raising questions, if any, at the appropriate 
time. 

Description of the Heugel Quill 

The Heugel Quill is a rectangular box, without 
a top, which has a perimeter lid. The lid, with 
one lever, clamps the paper into place, drawing the 
paper taut, stretching it with the clamping mechan- 
ism away from the center of the page. Above the 
page is a stylus, with a flat circular foot that, 
upon being placed to the surface of the paper, 
offers a small channel into which a reciprocating 
pin hammers from below the surface of the paper. 
The stylus and the motor driven reciprocating foot 
(9000 RPM) are constantly in mirror image to each 
other, upon the stylus being placed to the paper. 
An arm arrangement connects the two, running from 
the stylus above the paper, to the back of the 
rectangular . frame, down, and then under the paper 
to the motor driven pin. The motor driven pin rests 
on a ball bearing apparatus that rests on a mechan- 
ism which offers movement in both x and y components 
and thus, in any direction at all. Figure 1 follow- 
ing shows the unloaded Heugel Quill, with lid down. 
Figure 2 shows a similar view with the horizontal 
bar in relaxed position, allowing the user access to 
the dial which raises and lowers the height of the 
pin. Figure 3 shows an end view with the lid open. 
Figure 4 shows the Heugel Quill in operation. 

Research Proposed 

Much research, which has been needed for a^^ 
long time, now is with an effective mechanical 
means with which that research can be performed. 
For instance ,. what is the most advantageous height 
and width for a raised line for six year old child- 
ren to read tactilely? What is it for twenty year 
olds? Is it different for different age groups? 
What is it for the mentally retarded? What is it 
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riGURE i. The Heugel Quill, unloaded, with the 
lid down* 




FIGURE 2, Horizontal bar in the relaxed position 
allowing the user access to the dial 
which raises and lowers the pin. 




FIGURE 3, End view of the Heugel Quill with the 
lid open. 




FIGURE 4. The Heugel Quill in operation. 



for those who" are diabetic and have reduced tactile 
senses? With the Heugel Quill the foot of the styr 
lus and height of the reciprocating pin can be 
adjusted so as to alter the deformation of the 
paper. Such questions as those above become pos- 
sible to answer. 

What spatial concepts now go untaught or .poor- 
ly taught because of the essential dependence on a 
method which is primarily one of inspection? How, 
using the Huegel Quill, may these be more effec- 
tively taught? As an, example, the teaching of the 
concept of a diagonal is described in [3]. It is a 
complicated and difficult procedure which is indi- 
cated. Does the Heugel Quill allow access more 
easily to the development of that concept and what 
is the technique? What are- the implications of the 
Heugel Quill for mobility training? What spatial 
concepts, if better developed, simplify mobility 
skill development? How is the Heugel Quill to be 
most effectively used as a mobility instrument? 

Many similar questions may now be approached, 
making more effective the training, teaching, and 
even employment of the blind. While other recent 
technological developments, such as the Optacon 
[1], the Cognodictor [2] or Visotactor [2] are of 
effective, but restricted use, the Heugel Quill 
offers advantage to the full population of the 
blind . 
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OPTICAL ANALOG BIOFEEDBACK CONTROL AND LICARNING DEVICES 



by 

Romld Hcrshel 
Rick Kataoka 
Naval Electronics liiboratory Center 
San Diego, California 92 152 

Introduction 

With the recent miniaturization of photoemission and detection 
arrays » compact incoherent optical computers potentially prove useful in 
electronic prosthetics. With the addition of optical memories, static 
deflection and resonating mechanical reed assemblies, and charge transfer 
devices, many combinations of analog jnathematical operations in tandem 
or parallel can be realized in real-time. Here, efficient optical and 
charge interfacing eliminate much of the auxiliary electronic hardware 
associated with digital systems and provide simplicity and greatly 
enhanced corapvitatlonal density. Outlined are some of the more promising 
concepts and tcehniques for analyzing single - and multichannel data for 
control and feedback learning applications. 

Analog vs Digital Charge -Optical (C/0) Converter 



When processing real signals, particularly bio- 
electronic outputs, one can often reduce accuracy require- 
ments over those necessary for precise analytic cal- 
culations. The precision of mathematical operations 
used in learning and control prolDlems such as integration, 
differentiation, spectral analysis, and correlation is often 
limited by the inlierent noise contributions in biosignals 
rather than by the computational errors associated with 
the processing hardware. Other nonoharacterizing por- 
tions of the signal such as background fluctuations not 
associated with a given stimulus further reduce the 
necessity for the high bit accuracy and reliability 
associated with digital methods. In general, accuracy in 
the range of 4-7 bits suffices. 

Other factors such as cost, size, and maintenance 
are important considerations in many biomedical appli- 
cations; for example, the requirement for A/D and D/A 
converters and associated high gain amplifiers for low 
level signals can be eliminated through efficient through- 
put interfacing. For pattern recognition problems 
requiring a largo library of stored functions, the use of 
spatial optica] ti"^insmission masks provides an inexpen- 
sive, spatially compact memory with immediate accessi- 
bility. If equipped with an adaptive optical memory, 
analog devices can be made self-programmable, thereby 
reducing or even eliminating the growing software require- 
ments of general-purpose computers. 

For real-time processing, a serious limitation of 
typical digital hardware systems is their sequential 
operation. Only with sufficient IcKv input data rates can 
multiplexing and time sharing techniques coupled \vith 
high speed sequential calculations compare with a true 
multichannel, input-output, parallel processor* Perhaps 
the future of analog signal processing systems may more 
closely approximate the operation of the human biocom- 
puter, where on the order of 10-^^ processing and memory 
neurons provide numerous adaptive low-resolution parallel 
processing circuits. 



Using miniature flexible reeds (Figure 1) which can 
either transmit or reflect an illumination source provides 
efficient charge -optical converters for low -level bio- 
potentials. Since the C/O converter pulse position modu- 
lates (PPM) the illuminated end of the reed (transmission 
mode), close proximity masking converts the reed 
deflection into an intensity modulation. Imaging a line or 
point source off the reed surface in the reflection mode 
allows more efficient use of illumination sources and 
subsequent photodeteetion stages. In either transmission 
or reflection, proper channeling of charges or potentials 
into the reed unit provides mathematical operations such 
as signal differencing and squaring (Figures la, lb). 

Reeds with high mechanical dampening act as bio- 
potential modulators whose Uesponse time is limited by the 
mechanical resonance (up to 10 kHz depending on reed 
construction). If higher bandwidths are required, PAM or 
PWM modulation of LED arrays (up to 10 MHz) can be 
used, requiring, however, additional amplification and 
modulation electronic circuitry. 

As DC integrators and sample and hold circuits the 
reed assemblies merely require high impedance outputs 
on the biopotential sensors for minimum charge leakage. • 
In^liis mode the reeds can also be used as efficient optical 
converters of accumulated charge on photodeteetion arrays 
found in intermediate and output stages of the processing 
system (2), Here, particular advantage of signal sub- 
traction can be realized in correlation and transform 
operations. 

Reed Spectrum Analyzers 

Frequency filtering of input signals can be achieved 
in real-time by an array of variable length reeds with low 
mechanical dampening (3). A single channel AC input acts 
simultaneously on a bank of narrow bandpass reed filters 
(Figure 2), where the time-averaged deflection of each 
reed is concentrated at its maximum amplitude points. 
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Figure 1. Charge-Optical (C/O) Keed Converter 

a. A fused quartz reed with a conducting metallic film acts as a 
miniature cantilever beam whose deflection is proportional to the potential 
difference between the input electrodes. A fixed potential V is applied 

to the reed and can be adjusted for the maximum range. A constant intensity 
source is transmitted through the reed end and is modulated by a mask whose 
transmission depends on the reed position. Hence, various PPM-PAM trans- 
formations are possible (shown is a rectifying threshold detector). 

b. The product of two inputs is achieved using the reed arid an ex- 
ternal electrode. 



Hence, reed position information can l)e transformed to an 
optical intensity by an appropriate transmission mask. 
Individual reed band widths can be varied through negative 
or positive feedback of the time-differentiated optical 
output, similar to the operation of active electronic 
filters. For many types of speech and visual learning 
applications the spatial distrtibution of reed frequencies 
can be made bandwidth proportional {log frequency) 
providing easier recognition of fundamentals and spectral 
shape factors. 

' Pattern Recognition -Matrix Multiplication 

A reference mask with squared-normalized trans- 
mission arrays, representing a pattern library, is 
illuminated by imaging an array of C/O rioed converters 
using cylindrical optics. (Figure 3) The integrated 
output of each line is displayed in PPM proportional to the 
charge accumulated on strip electrodes located behind 
the mask. This technique is useful for real-time feedback 
to the observer where, in general, PPM has a higher 
through-put than intensity modulation for fast visual 
localization of the maximum correlation. For learning 
muscular coordination the library mask may consist of 
sequential patterns where the inputs are varied to achieve 



temporally smooth correlation changes in the visual feed- 
back output. 

If the output of the matrix multiplication is used for 
direct control, higher sensitivity to a specific pattern is 
desirable* One possible approach is to replace the 
library mask with its matrix inverse with the drawback of 
greater sensitivity to noise. The inverse of positive 
matrices consists of positive and negative elements. 
Since all detection and intensity transmission processes 
are inherently positive, subtraction is performed by 
separating negative and positive contributions using 
bipolar photo sensitive electrodes on the reed deflectors. 

Correlation 

Correlation between two functions, written as 

C(t) - /f(t+T ) g(t)dt 

can be performed using incoherent optical methods by 
illuminating a mask function g(x) with a soui'ce intensity 
modulated by f (t)# The intensity modulated image of g(x) 
is then translated uniformly on an integrating surface 
performing the above mathematical operation. With the 



o 

ERIC 



151 

i 



development of charge transfer devices, the translation 
and integration can be performed by an array of photo 
detectors which integrate the incoming signal and shift 
charges laterally across the array upon command from a 
timing circuit. Hence, the mask g(x) can be placed in 
direct contact with the detector array and illuminated with 
an intensity modulated source (Figure 4), Both imaging 
optics and mirror scanners are eliminated. Multichannel 
charge transfer devices with multichannel inputs achieve 
parallel correlation operations. Correlation with positive 
and negative signals and masking functions would require 
special quadrant techniques on the light modulation and 
detection stages. The accumulated charge distribution on 
the charge transfer detector array can then be displayed 
optically using reed deflectors. 

Correlation between two or more input signals is 
achieved in real time by inputting sums and differences of 
signals into the reed spectrum analyzers to obtain the 
cross-power spectrums of the input channels. Cross 
correlations are then found by reading the output of the 
reed analyzers with a charge transfer device and per- 
forming fourier transforms. 



Transforms 

All transforms f(r) of the fox-m 

F(u.) - Ji{T )T(wT ) dT 

can be performed on an input signal f(T) using the 
incoherent optical correlation methods discussed in the 
previous section. For fourier transforms two PWM 
spatial masks are required of the form (Figure 4"). 

g^ (x) ^ cos e^ 

gg (X) = sin e^ 

where positive and negative portions are separated into 
two channels. By a non-uniform. translation proportional 
to log T, the correlation output will be the fourier trans- 
form in log oi With a multicliannel input, a number of 
fourier transforms can be taken simultaneously. 
Frequency matched filtering is achieved incoherently by 
placing a matrix multiplication stage behind the C/0 




Figure 2. Reed Spectrum Analyzer 



An assembly of different length reeds acts as a bank of bandpass filters 
whose center frequencies are spatially oriented in any desired fashion. The 
Incoming signal f(t) Is filtered and optically converted into a spatial in- 
tensity distribution proportional^ to the square root power in each frequency 
band. This is accomplished by modulating the constant illumination at the 
reed end by a ramp opening. 
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Outputs to C/0 




Figure 3. Matrix Multiplication of the Input Array 

An array of reed deflectors converts multichannel biopotential inputs 
into a 1-D spatial intensity pattern which is imaged as a line pattern onto 
a matrix mask. The total light passing through each row of the matrix is 
detected by photosensitive strips followed by an array of. C/0 converters 
(not shovm) . 




Figure A, Correlation and Transforms using Charge-Transfer Detection Arrays 

A PAl-I or PWM source. f(t) illuminates a reference mask (shown for fourier 
transform operation). Correlation is performed by shifting charges in the 
detector array with timing pulses («log t for FT) with intermediate charge 
integration by each photodetector element. The resulting charge distribution 
may then be optically displayed through C/0 arrays or read off the end of the 
charge transfer device. 
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converted output followed by another fourier tninsform 
stage, 

Self-Programmable Optical Computers 

The foregoii^ pattern recognition approaches rely 
on an optical library of stored functions. Recording the 
desired set of reference signals or spectra on a photo- 
graphic mask with the same optical circuitry used for 
subsequent processing achieves real-time programming, 
matched to the particular analog deviee (3). This pi'o- 
cedure considerably reduces pattern recognition error 
due to mechanical and optical variations among individual 
units. Using erasable photochromic or liquid crj'^stal 
substrates eliminates the need for removal, development, 
and reinsertion of photographic recordings (4) (5). 

Since the human biocomputer updates information 
during the process of learning, real-time adaptive memory 
and filtering capabilities appear highly desirable for 
optieal computers. With relatively simple optical and . 
electronic circuitry, more complex operations such as 
cluster and factor analyses could be performed on large 
signal sets. Such capabilities would add a new dimension 
to the development of biofeedback learning devices and 
sensory -motor aids. 

Summary 



processing stages between input and output, on rcal-timo 
parallel processing and self -programming capabilities, 
and on maximum computatiomil density. The essential 
technology (material, optical, and eicctronic) already 
exists for implementing the foregoing analog designs. 
Present research in integrated optics, compact and stable 
coherent systems, and optical storage units will greatly 
enhance optical computer design for prosthetic appli- 
cations. However, more emphasis is needed in under- 
standing the human biocomputer so that we may develop 
more effective aids to perception, learning, and control. 
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THK DESIGN AND BUILDING OF 



A WRITING MACHINE 

James W. Fee, Jr. 
Student, Department of 
Mechanical Engineering* 
College of Engineering 
University of Kentucky 



There is an old saying that "Necessity is the mother 
of invention." If one is willing to acknowledge this, and 
the fact that a child is largely the product of his parents, 
it can then be concluded that the best way to understand 
this project, the "child" if you will, is to gain some in- 
sight into the necessity for this invention. 

The need for this prosthetic device comes from the 
author's own disability, cerebral palsy. The effect of 
this handicap is a loss of coordination, to a greater or 
lesser extent, in all four limbs. This lack of coordination 
causes two problems, one is the inability to execute 
small, intricate motions accurately. The second, is what 
is medically known as tremor, or an involuntary shaking* 
Both of these render writing on a small scale impossible 
and on a large scale far from anything beautiful, when 
measured from the point of view of penmanship. 

This then will be a statement of the problem at hand: 
to take the gross motion of the author, in the form that 
it exists, and transform it into a size and legibility 
both practical and pleasing to the eye. 

As a starting pointy let it be clearly understood that 
the larger the author writes a letter the more readable 
it becomes, as can be seen from figure 1, The problem 
stated again, in terms of mechanics, is to convert a 
large vector whose components are DX, DY into a small 
vector whose components are dx, 6y. This must be 
accomplished in such a way that DX/dx = DY/dy in every 
case. 

The solution to this problem would be rather simple 
if all that was needed was a reduction of a large sheet of 
paper with large letters (which is what the author writes 
on now) to a small sheet of paper with small Irstters. This 
could be done with a drawing pantograph or by photographic 
reduction. However, this would require the use of the 
large paper and the intervening time and work. The 
kind of solution that the author has worked for is one that 
will allow all symbols (letters, numbers, etc.) to be 
written in the same space on a surface area of about one 
square foot. To enable one to do this, some form of 
indexing must be provided, "^either in the form of moving 
the paper, as in a standard typewriter, or moving the 
writing implement, as is dons in the IBM Selectric 
typewriter. 

The author can use a typewriter very efficiently, 
his major objection to using it is the fact that it lacks 
all the characters that are needed to make Engineering 
calculations. It is however, the author^ s hope that at 
some future time and under some future project, the 
writing machine that was designed could be greatly 
simplified and incorporated in a standard typewriter. 



The simplifications would come in the form of eliminating 
any need for indexing since the typewriter itself would be 
able to perform this function. Any problems in combining 
the two machines will not be dealt with in this report. 

THEORY AND ANA LYSIS 

As a beginning point let the reader turn his attention 
to figure 1. It can be seen here that as the author's 
written characters are made larger there is a point 
reached where the lines begin to flow, somewhat. If a 
movie were taken of the author as these characters were 
made it would be seen that for the very small letters the 
author uses his wrist and fingers to make the letters. 
As he progresses to the larger letters there is more and 
more motion of the arm. It is when using this arm 
motion that the author does his best writing. 

What was wanted then, for the man-machine inter- 
face, was some type of handle that would have two degrees 
of motion (X and Y) over an area of about one square foot. 
This was accomplished using an electronic joy stick, 
figures 2-5, ^ 




FIGURE 1. Size comparison of the author's 
writing. 
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of the author's hand* 



FIGURE 2. The electronic joy sticks 




The joy stick consists of a set of gimbals which 
were once part of an electronic gyro. The axles of the 
gimbals are mechaiiieally connected to the wipers of two 
rotary potentiometers. The electrical diagram for this 
piece of equipment is shown in figure 6. 

This then was our means of converting the autlior's 
arm motion into an electrical signal. It did accomplish 
the requirements quite well. Of course the gimbals 
provided the two degrees of motion. By lengthening or 
shortening the handle, the desired writing area was 
obtained. For the beginning weeks of this work the joy 
stick was used as shown in t'igxire 5. The base was 
simply set on the table top and the letters were written 
on an imaginary plane at the top of the stick where it 
was held in the hand. 




If figure 5 is studied, one will note a piece of card- 
board covering the base of the joy stick, this was used 
as a stencil. Figure 7 is a reproduction of the stencil, 
the cross-hatched section is the part that was cut out for 
the joy stick handle. This stencil comes from the basic 
layout lines for most standard letters. These linos are 
shown for 2 inch letters in figure 8. 

The instrument used for the output of this project 
was a Moseley x-y recorder. This recorder is built by 
Hewlett Packard/Moseley Division. Figure 9 shows an 
actual photograph of Ihe recorder, figure 10 is a block 
diagram of the electronics of the recorder, and figure 11 
shows the internal operating parts. These last two . 
figures were taken from the instruction manual printed 





FIGURE 9. Moseley X-Y recorder. 



FIGURE. 7. Dimensions of the stencil. 
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FIGURE 10. Block diagram of the recorder. 
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FIGURE a. better layout lines, 

by the manufacturer. The amplifiers on both the x and y 
axis have 9 different amplification values. They are: 
0.1, 0.2, 0.5, 1.0, 2.0, 5.0, 10.0, 20.0, 50.0. These 
are given in millivolts per inch movement of the pen. 
With this range of values and by varying the input voltage 
to the pots of the joy stick, one has the option of almost 
any factor of amplification of reduction of input letter 




FIGURE 11, Internal operating parts 
of the recorder. 
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size. Another feature of this recorder is the remote pen 
lift control. 

The power supplies for the project (when the system 
was completed there were four of them) were made by 
Lambda Electronics Corp. Figure 5 includes two of the 
power supplies. These power supplies each supply 0-40 
volts and 0-(1.3-l. 8) amps at 86°F. 

As was stated earlier, tliis machine was designed in 
such a way that, like a typewriter, it could only write one 
letter at a time before the pen had to be indexed to a new 
position. Therefore, after each letter was written sonic 
means was needed for moving the pen over the paper. 
The Moseley x-y recorder works on the principal that 
the position of the pen is a function of the input voltage. 

To solve the problem of indexing, a long series of 
resistances were used as voltage dividers. The series of 
resistances were divided into a number of tapped equal 
parts, (at first there were 10, IK ohm resistors with a 
tap at each IK ohm) and the taps were hooked to the ten 
terminals of a ten position Strowger relay. This relay is 
nothing more thrn an electrically operated stepping switch. 
The common terminal of this relay was at first hooked to 
the "X** side of the recorder. As the switch was stepped, 
the pen moved to ten different positions on the paper. 
On each of these ten positions, then one letter was 
written. The distance the ten letters were to be spaced 
apart could be controlled by the value of the voltage across 
the entire series of resistances. 

It was soon found that the ten positions in the "X" 
direction was not enough. In the final prototype two 
twenty-five position switches were used for the "X" and 
the ten position switch was used for the "Y".* 

PROCEDURE 

The first test made during this, project was to 
determine the way in which the joy stick was wired. As 
can be seen in figiire 6, the joy stick cair o with five 
leads coming out of it. It was thus necessary to deter- 
mine which were which. Since the two wires coming to 
point D were visible to the eye, this was assumed to be 
a common point for both potentiometers. One side of an 
ohm meter was then hooked to point D. The other side 
was touched to points A, B, C and E, one at a time, 
while the joy stick was moved. If the meter showed a 
constant ohms value as the stick was moved, point A or 
E was found. If the needle of the meter deflected as the 
stick was moved point B and C were found. 

Having identified all five contacts, two voltage 
supplies were used, and the joy stick was hooked up* The 
two positive sides of the power supplies were hooked to 
A and E respectively, the two negative poles were hooked 
together, both connected to terminal D. Terminals B and 
C were then connected to the "Y" and "X" sides of the 
recorder, respectively. 

*The two twenty-five position switches were generously 
given to tlie Univeijsity by the Generhl Telephone 
Company of Kentucky, for which the author is very 
grateful. Figures 12-14 are actual photographs of the 
switch. 
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FIGURE 12\ Ti^7enty-five position, four pole 
stepping relay. 




FIGURE 13* Tiventy-five position, four pole 
stepping relay. 




FIGURE 14 » Twentyfive position , four pole 
stepping relay. 
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FIGURE 15. A written "J" with very noticeable 
distortion caused by the tremors 
in the .authors hand. 

At first the author had in mind the thought of pro- 
dueing rather large letters on the reeorder. His first and 
only attempt at this is shown in figure 15. This is, as 
can be seen, the written letter "J". One will note 
immediately the tremor of the author's hand as evidenced 
by the waviness of the line. This tremor is of course due 
to the author's handicap, but it is also enhanced by the 
position of the author's hand. This letter was written with 
the joy stick held as in figure 5. Note that in this position 
there is nothing to prevent the tremor. .In engineering 
terms there is no damping in the system $it all. 

The problem of damping was not attaciiked at this 
point. Instead, what was done was to decreiise the ampli- 
fieation in order to write smaller letters. At ean be 
\imagined, as the letter gets smaller, so does Ihe distance 
from the maximum to the minimum points in a given wave 
due to a given tremor. 

Just how well these letters ean be made using ampli- 
fieation in the parts-of-one '"mge, can be seen in figure 



This is a sample of typing. 
ABCDEFGHIJKLMN 
abcdefghijklmn 

abcdefghij<lmm 

c 



FIGURE 16. Typing compared with machine writing. 
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FIGURE 17, Wiring diagram' of the system at the 
end of the first stage* 

1(3. In this sample, typing is being compared with that 
which can be produced on the machine being designed. 

Next, the problem of indexing was addressed. 
Before anything elaborate was made, the theory that 
indexing could be done using a voltage divider was tested. 
To do this, ten resistors of one K ohms each were 
connected in series; a voltage was placed across the ten 
resistors; and, by using a test wire that was connected 
to the "X" side of the recorder, one could begin at the 
negative end of the resistor banl\ and touch the wire to 
each contact between the resistors and thus step the pen 
across the paper. 

Having found this to work, the ten contact points 
were then connected to the ten terminals of a'Strowger 
rcla3\ Two switches were used to step and reset the 
relay. In order to produce movement in the "Y" direction 
a rotary potentiometer was used as a voltage divider. 

■ This completed what the author will call the first 
stage of the design of this writing machine. At this 
point we could write practically any size letter and index 




FIGURE 18. Overall view of the writing machine 
at the end of'the,-^f^i'rst stage. 
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in both directions. A wiring diagram and a photograph of 
the system at the end of the^ fi rst stage are given in 
figures 17 and 18, respectively. In the wiring diagram, 
it might be noted that the output from the joy stick and the 
indexing circuit must be fed through two resistors for each 
direction before being connected to the input of the X-Y 
recordor. This will prevent any adverse effect from a 
voltage potential between the outputs of the joy stick and 
the indexing circuit. 

There are several things in the first stage that were 
lacking, these will be left for a discussion under the 
headings "Results" and "Conclusions", For now the next 
stage of the design will be described. 

The most obvious improvement that could be made 
was to add more indexing. This was done by adding two, 
twenty-five position relays. By connecting micro switches 
across the stepping relay, it could be stepped one step 
at a time- These stepping relays were put in the circuit 
in such a way that the two together produced fifty steps 
in the "X" direction. The ten position relay was then 
employed in the "Y" direction'to produce ten lines. The 
voltage divider to produce the fifty steps was made of 
fifty, 2,61K ohm resistors connected in series, A tap 
was placed at each end of the string and on each junction 
of the fifty resistors. These were then hooked to the fifty 
taps on the stepping relays. In order to provide an option 
of indexing over a number of spaces, a telephone dial was 
connected in parallel with the micro-control switch. By 
making use of a single pole -double throw switch that was 
flipped automatically when the first stepping switch 
reached position number 25 > both stepping relays could 
be controlled by one micro switch and thus (since they 
are connected in parallel) by one telephone dial. Like- 
wise, in the reset circuit, the automatically operated 
single pole-double throw switch on the second stepping 
relay was used to eliminate a second button in the reset 
circuit. 

After indexing, the next problem was that of damping 
the arm motion of the subject. This was accomplished 
by turning the joy stick upside down and hanging it from 
the underside of a small table built for this purpose. By 
making the handle of the joy stick longer and putting a 
plate under it, several things could be accomplished. 
Not only did the plate provide something for the author ' 
to rest his hand on, but, by putting a spring inside the 
handle, allowing an up and down movement, a control 
for both the pen lift and the indexing micro switch were 
made. 

The pen lift control on the x-y recorder came in the 
form of a female outlet,. Into this outlet could be plugged 
a male plug with two wires on it. If the wires were 
connected the pen would contact the paper. By making the 
writing plate of the joy stick table of metal (in this case 
aluminum) and by connecting one side of the pen lift plug 
to it and the other to the joy stick handle, when the . 
handle was pushed onto the plate, the pen would go down. 
Further, by making the spring that held the joy stick 
handle in a neutral position both an extension and com- 
pression spring, the upward degree of freedom could be 
used to activate the indexing micro switch. This 
switching mechanism can best be seen in the actual photo- 
graph, figure 10. On this table were also mounted the 




FIGURE 19. X-step switch luGchanism. 




FIGURE 20, Dial and switch panel, 

"Y'^ stepping switch, the "Y" reset switch, the "X" reset 
switch, and the telephone dial. A photograph of this 
switch panel is shown in figure 20. Other photographs 
of the final stage of the system, the final wiring diagram; 
and a diagram of the joy stick table are shown in figures 
21. 22, 23 and 24. • 

As a final test of the prototype machine, the autlior 
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performed one typical homework problem in Machine 
Design, first the usual way on an 18 x 24 inch paper and 
then on an 8-1/2 x 11 inch paper using the writing 
machine. Illustrations of those two papers can be seen 
in figures 25 and 26. 

RESULTS . ^\ ■ 

From the test to determine the position of the 
different connections oh the Joy Stick, it was found that 
the wipers were connected to bare steel wires. The two 
points A and E of figure 6 were foxmd to have black plastic 
covered wires connected to them. 

By using two different voltages on two different volt- 
age supplies, and different ranges on the ''X" and "Y" 
side of the recorder, one could obtain the result: dY/dy = 
dX/dx with the two voltages. This was useful in the first 
stage of the system but was abandoned in the second stage. 

Turning our attention now to figures 15 and 16, we 
can examine what a reductipn in size of this kind can do. 
In figure 15 one sees the letter "J^' written about 1.8 inches 
high. (This graph paper has ten squares to the inch) The 
two pencil lines drawn at the maximum and minimum of a 
wave tremor can be found to be ,25 inch apart. Now turn 




FIGURE 21. ' Hand position at the 
final stage* 




FIGURE 22. Overall view of the writing machine 
in the final stage* 




FIGURE 23. Wiring diagram of the final 
prototype system* 

to figure 16, here the letters arc . 15 inch high. This is 
a reduction of 12 times, that is the letters in figure 16 
are 1/12 the size of the letters in figure 15. Since the 
amplifier reduces everything in proportion, if the tremor 
that occurred at the time that the ^'J" of figure 15 was 
written had occurred during the time that one of the letters 
of figure 16 had been written, the size of the wave would 
be reduced to . 02 inch. 

To give the reader some idea of just what tliis 
machine could do at the end of the first stage, turn to 
figures 27 and 28. Figure 27 is the author's writing 
without the machine. Figure 28 is the authors writing at 
the end of the first stage. 

As was mentioned in the ^'Procedure", dam ping the 
motion of the writers arm was a problem in the system at 
the end of stage one. There is a current theory about 
cerebral palsy that states: the abnormal motions of a 
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pc r SOU:- suEfc ring from cerebral palsy is due to the 
destruction of the feedback centers of the brain. Whether 
or not this theory is true remains to be seen, but it is 
enough to say that a sufficient lack of feedback must have 
been observed in enough victims to warrant such a theory. 
One can therefore conclude that in any prosthetic device 
for the cerebral palsied there must be as much built in 
feedback (in the form of damping) as is possible. 

In most of the problems the author has encountered 
in his lifetime, the lack of damping was overcome by using 
friction between the limb involved and sonic working sur- 
face. It was from this knowledge, that damping could be 
obtained by rubbing the arm on something, that the 
decision to turn the joy stick up -side-down was made. 
As can be seen from figure 19, with this modification the 
author could rest his Iiand on the writing surface while 
writing. 

A second advantage of having the joy stick mounted 
in the position of figure 21 is that the writing plane is real 
and no longer imaginary. In figure IS one can sec that che 
tip of the joy stick will plot an imaginary plane in mid air. 
It was on this imaginary plane that the subject wrote. 
Several people who tried to use the machine at this stage 
found the imaginary plane hard to deal with. 

At the end of the first stage the pen lift switch and 
the indexing switch were separate from the joy stick. 
This proved to be inefficient, and, as was mentioned 
earlier, was eliminated. The three degrees of freedom 
of the writing stylus are shown in figure 24. 

In order to better understand some of the automatic 
features of the final stage of tlic system , let us turn our 
attention to figure 2.3. Start by assuming that one is 
writing on a new page starting at the top left hand corner. 
At the starting time the Strowgcr relays are both on 
position one. We imagine writing letters and closing the 

Step Switch" after each letter is written. This fires 
the coil of the first "X" stepping relay. Doing tliis, the 
step relay will progress around the first twenty-five 




1, r--(7fc/r Liri'f^a c-r %^^s<^Qrrc, 
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FIGURE 25. A sample of the author's writing 
used in completing a homework 
assignment. 
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FIGURE 26, 



The same TQssignment shown in Fig. 25 
rewritten on the writing machine. 



FIGURE 24, Note the three degrees of stylus 
. freedom. 



contacts. When contact twenty -five is reached, contact 
D25 connects the "X Step Switch" to the second step relay. 
On the next closing of the "Xstep Switch", both relays 
fire and the first step relay moves to the neutral position, 
the second moves to the twenty -sixth position. We thus 
have a smooth changeover from one relay to the other. 
Note that when the first step relay reaches the neutral 
position a finger on pole B moves a SPDT from one 
contact to the other, this disconnects the "X Step Switch" 
from the first relay and connects it to the second. The 
second step relay then proceeds around the next twenty- 
five contacts. When contact fifty is reached, the "X Step 
Switch" is connected to the first step relay by contact 
C5Q and to the "Y Step Switch" by contact D50. When the 
"X Step Switch" is again closed all three relays fire and 
the pen moves to the beginning of the next line. Note the 
resistance in the circuit from contact D50 to the "Y Step 
Switch, Step Relay". At the time when ajl three of these 
stepping relays fire together they are connected in 
parallel. It was found that the ten position, relay had so 
little resistance that when it fired the other two did not. 
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FIGURE 27. Author's writing before the machine. 

With this resistance in series with the Step Relaj' the 
problem was solved. 

Note also that the Step Switeh, Step Relay" steps 
from the positive end of the bank of resistors to the 
negative end. This is due to the faet that the "Y Step 
Switeh" steps down the page and for this one needs more 
and moi'e negative voltage. - 

If one studies figures 17 and 23, it will also be seen 
that in figure 17 the common point on the joy stick is 
negative, while in figxire 23 it is positive. It was necessary 
to change this in the second stage because when the joy 
stick was turned up -side -down the mirror image of the 
letter was transmitted to the recorder, by changing the 
polarity the mirror image was converted back to the real 
image. 

When the reset circuit is followed it will be found 
that the two "X Stepping Relays" follow after each other 
until they both return to position one. The resistor in this 
i circuit was used to slow down the relay so it would not 
overrun the stopping point. The two diodes in this circuit 
were needed to stop feedback from the step circuit Into the 
reset circuit. 



ExlR 

FIGURE 28. Author's writing with the machine 
(first stage) , 

There are three SPST relays in the diagram (figure 23} 
from left to right: the first stops the reset circuit at the 
right contact (one). The second opens the main indexing 
lino during resetting to give a smooth operation. And 
the third turns the telephone dial from a normally closed 
to a normally open switch. 

This second relay needs some explanation. If one 
studies the diagram he finds that the reset mechanism on 
the twenty-five position relays is just a 'fast forward. If 
the circuit were hooked up without the relay the pen would 
run across the paper while the relays were resetting. 



CONCLUSIONS 

An effective writing prosthetic device can be made 
using an electric joy stick as input and an X-Y recorder 
as output. 

It is hoped that at some later date tliis machine can 
be incorporated in a standard typewriter, thus eliminating 
the need for indexing and increasing the speed of the 
writing process. 
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